Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12967 originally caused by: Started by upstream project "master-openbsc" build number 13163 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17654 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2949 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29262 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30039 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12967 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3015963930280672149.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 20:04:33 + trial_dir_prefix=trial- + rm -rf trial-2363 trial-2363-bin.tgz trial-2363-run.tgz + trial_dir=trial-2364 + mkdir -p trial-2364 + mv open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz trial-2364 + cat open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30039.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4699.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2364 combinations: None trial: 'trial-2364' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2364 -------------------------------------------------------------------------------------------- 20:04:44.113387 tst trial-2364: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/log --------------------------------------------------------------------- trial-2364 nitb_sms:sysmo --------------------------------------------------------------------- 20:06:50.671714 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:06:50.675628 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 20:06:50.697177 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 20:06:50.706140 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 20:06:50.761822 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 20:06:50.783616 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 20:06:50.791459 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 20:06:51.329321 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:06:51.334497 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 20:06:51.345805 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 20:06:51.729605 tst mo_mt_sms.py: using LAC 23408 20:06:51.977744 tst mo_mt_sms.py: using RAC 203 20:06:52.102896 tst mo_mt_sms.py: using CellId 23408 20:06:52.228864 tst mo_mt_sms.py: using BVCI 23409 20:06:52.345633 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:06:52.528155 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 20:06:52.650378 tst mo_mt_sms.py:9: start nitb and bts... 20:06:52.870297 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:06:55.234916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9747): Launched 20:06:55.563065 run osmo-nitb_10.42.42.2(pid=9748): Launched 20:06:55.741877 run osmo-nitb_10.42.42.2(pid=9748): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9748)] 20:06:55.875982 run osmo-nitb_10.42.42.2(pid=9748): stdout: | (launched: 2022-12-09_20:06:55.502169) 20:06:56.011729 run osmo-nitb_10.42.42.2(pid=9748): stderr: | (launched: 2022-12-09_20:06:55.550819) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:06:56.147540 run osmo-nitb_10.42.42.2(pid=9748): stdout: | (launched: 2022-12-09_20:06:55.502169) 20:06:56.277752 run osmo-nitb_10.42.42.2(pid=9748): stderr: | (launched: 2022-12-09_20:06:55.550819) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:06:56.433447 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9748): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9748) [trial-2364↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9748)] [trial-2364↪nitb_sms:sysmo↪mo_mt_sms.py:11] 20:06:56.442394 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 20:06:56.449562 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9747): Terminating (SIGTERM) 20:06:56.660906 --- ParallelTerminationStrategy: PID 9747 died... 20:06:56.682238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9747): Terminated: ok {rc=0} 20:06:56.771607 bus /sierra_3: Setting Powered False 20:06:57.873775 bus /sierra_3: Setting Powered False 20:06:58.994632 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:sysmo --------------------------------------------------------------------- 20:07:00.177255 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:00.181603 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 20:07:00.203250 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 20:07:00.231843 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 20:07:00.286622 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 20:07:00.308301 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 20:07:00.336006 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 20:07:00.885430 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:sysmo mo_mt_sms.py ---------------------------------------------- 20:07:00.890667 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:00.903030 tst sms:sysmo: Using 1 x bts (candidates: 1) 20:07:00.945085 tst mo_mt_sms.py: using LAC 23409 20:07:01.085166 tst mo_mt_sms.py: using RAC 204 20:07:01.239852 tst mo_mt_sms.py: using CellId 23409 20:07:01.391738 tst mo_mt_sms.py: using BVCI 23410 20:07:01.549616 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:01.564750 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:01.580298 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:01.595655 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:01.611420 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 20:07:01.626435 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:07:01.778712 tst sms:sysmo: Using 1 x modem (candidates: 2) 20:07:01.908395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:03.686492 run create_hlr_db(pid=9755): Launched 20:07:03.806492 bus /sierra_2: Setting Powered False 20:07:04.867562 run create_hlr_db(pid=9755): Terminated: ok {rc=0} 20:07:05.318893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Launched 20:07:05.649479 run osmo-hlr_10.42.42.2(pid=9758): Launched 20:07:05.776478 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:08.366435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Launched 20:07:08.697626 run osmo-stp_10.42.42.5(pid=9761): Launched 20:07:08.822308 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:14.301456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Launched 20:07:14.609878 run osmo-msc_10.42.42.6(pid=9764): Launched 20:07:14.781410 run osmo-stp_10.42.42.5(pid=9761): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] 20:07:14.911868 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-09_20:07:08.635760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:15.041457 run osmo-stp_10.42.42.5(pid=9761): stderr: | 20221209200708833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200708833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200708833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200708834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200708834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200708834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200708834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:15.168935 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-09_20:07:08.635760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:15.291506 run osmo-stp_10.42.42.5(pid=9761): stderr: | 20221209200708833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200708833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200708833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200708834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200708834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200708834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200708834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:15.437774 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2364↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] [trial-2364↪sms:sysmo↪mo_mt_sms.py:16] 20:07:15.446425 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 20:07:15.472922 run osmo-hlr_10.42.42.2(pid=9758): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9758)] 20:07:15.521372 run osmo-hlr_10.42.42.2(pid=9758): stdout: | (launched: 2022-12-09_20:07:05.587724) 20:07:15.571786 run osmo-hlr_10.42.42.2(pid=9758): stderr: | 20221209200705790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200705790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200705790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200705790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200705790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200705790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200705803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200705812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200705812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200705812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:15.641298 run osmo-msc_10.42.42.6(pid=9764): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9764)] 20:07:15.689645 run osmo-msc_10.42.42.6(pid=9764): stdout: | (launched: 2022-12-09_20:07:14.551850) 20:07:15.739597 run osmo-msc_10.42.42.6(pid=9764): stderr: | 20221209200714827 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200714827 DLGLOBAL DEBUG validating counter group 0x7f954e3adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200714827 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200714827 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200714828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200714828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200714830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200714830 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200714830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200714830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:15.790015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminating (SIGTERM) 20:07:15.831408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminating (SIGTERM) 20:07:15.877031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminating (SIGTERM) 20:07:15.930061 --- ParallelTerminationStrategy: PID 9757 died... 20:07:15.950326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminated: ok {rc=0} 20:07:15.997759 --- ParallelTerminationStrategy: PID 9760 died... 20:07:16.017431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminated: ok {rc=0} 20:07:16.067093 --- ParallelTerminationStrategy: PID 9763 died... 20:07:16.092888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminated: ok {rc=0} 20:07:16.198696 bus /sierra_3: Setting Powered False 20:07:17.307559 bus /sierra_3: Setting Powered False 20:07:18.424916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:sysmo --------------------------------------------------------------------- 20:07:19.636669 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:19.640447 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:07:19.661426 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 20:07:19.668776 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:07:19.702764 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:07:19.724891 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 20:07:19.732214 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:07:20.252529 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 20:07:20.258115 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 20:07:20.269437 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 20:07:20.305325 tst assert_extension.py: using LAC 23410 20:07:20.447516 tst assert_extension.py: using RAC 205 20:07:20.568121 tst assert_extension.py: using CellId 23410 20:07:20.688294 tst assert_extension.py: using BVCI 23411 20:07:20.799258 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 20:07:20.919842 tst assert_extension.py:10: start nitb and bts... 20:07:21.141253 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:07:21.809068 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9769): Launched 20:07:22.139893 run osmo-nitb_10.42.42.2(pid=9770): Launched 20:07:22.322581 run osmo-nitb_10.42.42.2(pid=9770): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9770)] 20:07:22.468332 run osmo-nitb_10.42.42.2(pid=9770): stdout: | (launched: 2022-12-09_20:07:22.078214) 20:07:22.615574 run osmo-nitb_10.42.42.2(pid=9770): stderr: | (launched: 2022-12-09_20:07:22.127086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:07:22.762629 run osmo-nitb_10.42.42.2(pid=9770): stdout: | (launched: 2022-12-09_20:07:22.078214) 20:07:22.904347 run osmo-nitb_10.42.42.2(pid=9770): stderr: | (launched: 2022-12-09_20:07:22.127086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9770) [trial-2364↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9770)] 20:07:23.264934 tst osmo-nitb_10.42.42.2(pid=9770): stdout: | (launched: 2022-12-09_20:07:22.078214) 20:07:23.396891 tst osmo-nitb_10.42.42.2(pid=9770): stderr: | (launched: 2022-12-09_20:07:22.127086) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:07:23.552463 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9770) [trial-2364↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9770)] [trial-2364↪nitb_ussd:sysmo↪assert_extension.py:12] 20:07:23.561533 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:07:23.568844 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9769): Terminating (SIGTERM) 20:07:23.778990 --- ParallelTerminationStrategy: PID 9769 died... 20:07:23.800523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9769): Terminated: ok {rc=0} 20:07:23.889858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:sysmo --------------------------------------------------------------------- 20:07:25.058739 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:25.063479 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 20:07:25.085516 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 20:07:25.112940 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 20:07:25.153965 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 20:07:25.176198 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 20:07:25.203951 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 20:07:25.757084 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:sysmo assert_extension.py ---------------------------------------------- 20:07:25.763093 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:25.776020 tst ussd:sysmo: Using 1 x bts (candidates: 1) 20:07:25.831894 tst assert_extension.py: using LAC 23411 20:07:25.989644 tst assert_extension.py: using RAC 206 20:07:26.113374 tst assert_extension.py: using CellId 23411 20:07:26.232337 tst assert_extension.py: using BVCI 23412 20:07:26.343196 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:26.354074 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:26.364541 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:26.375400 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:26.386004 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 20:07:26.396497 tst ussd:sysmo: Using 1 x modem (candidates: 1) 20:07:26.515100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:27.026348 run create_hlr_db(pid=9774): Launched 20:07:27.161880 bus /sierra_2: Setting Powered False 20:07:28.226236 run create_hlr_db(pid=9774): Terminated: ok {rc=0} 20:07:28.665704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Launched 20:07:28.975169 run osmo-hlr_10.42.42.2(pid=9777): Launched 20:07:29.093635 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:29.625986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Launched 20:07:29.934891 run osmo-stp_10.42.42.5(pid=9780): Launched 20:07:30.053858 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:30.608582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9782): Launched 20:07:30.950590 run osmo-msc_10.42.42.6(pid=9783): Launched 20:07:31.357140 run osmo-stp_10.42.42.5(pid=9780): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] 20:07:31.670781 run osmo-stp_10.42.42.5(pid=9780): stdout: | (launched: 2022-12-09_20:07:29.876672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:31.802680 run osmo-stp_10.42.42.5(pid=9780): stderr: | 20221209200730048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200730048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200730049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200730049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200730051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200730051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200730051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:31.934868 run osmo-stp_10.42.42.5(pid=9780): stdout: | (launched: 2022-12-09_20:07:29.876672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:32.060870 run osmo-stp_10.42.42.5(pid=9780): stderr: | 20221209200730048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200730048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200730049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200730049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200730051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200730051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200730051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:32.211755 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9780): Process ended prematurely: osmo-stp_10.42.42.5(pid=9780) [trial-2364↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] [trial-2364↪ussd:sysmo↪assert_extension.py:17] 20:07:32.221328 tst assert_extension.py:17: Test FAILED (6.5 sec) 20:07:32.250961 run osmo-hlr_10.42.42.2(pid=9777): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9777)] 20:07:32.301127 run osmo-hlr_10.42.42.2(pid=9777): stdout: | (launched: 2022-12-09_20:07:28.916896) 20:07:32.353109 run osmo-hlr_10.42.42.2(pid=9777): stderr: | 20221209200729098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200729098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200729098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200729098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200729098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200729098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200729143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200729152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200729153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200729153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:32.422843 run osmo-msc_10.42.42.6(pid=9783): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9783)] 20:07:32.470965 run osmo-msc_10.42.42.6(pid=9783): stdout: | (launched: 2022-12-09_20:07:30.868029) 20:07:32.520740 run osmo-msc_10.42.42.6(pid=9783): stderr: | 20221209200731402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200731403 DLGLOBAL DEBUG validating counter group 0x7f1bdc639c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200731403 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200731403 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200731403 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200731405 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200731408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200731409 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200731409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200731410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:32.570846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminating (SIGTERM) 20:07:32.610953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Terminating (SIGTERM) 20:07:32.650871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9782): Terminating (SIGTERM) 20:07:32.691168 --- ParallelTerminationStrategy: PID 9776 died... 20:07:32.710300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminated: ok {rc=0} 20:07:32.755006 --- ParallelTerminationStrategy: PID 9779 died... 20:07:32.773604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9779): Terminated: ok {rc=0} 20:07:32.818046 --- ParallelTerminationStrategy: PID 9782 died... 20:07:32.836601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9782): Terminated: ok {rc=0} 20:07:32.922250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:07:34.120409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:34.127326 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:07:34.148928 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:07:34.176481 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:07:34.228456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:07:34.250210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:07:34.278693 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:07:34.829457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:07:34.885151 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:34.896507 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:07:34.953251 tst mo_mt_call.py: using LAC 23412 20:07:35.082929 tst mo_mt_call.py: using RAC 207 20:07:35.214401 tst mo_mt_call.py: using CellId 23412 20:07:35.338007 tst mo_mt_call.py: using BVCI 23413 20:07:35.452901 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:35.464172 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:35.475247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:35.486920 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:35.498395 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:35.509818 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:35.631856 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:35.750468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:36.239163 run create_hlr_db(pid=9790): Launched 20:07:36.359210 bus /sierra_2: Setting Powered False 20:07:37.421528 run create_hlr_db(pid=9790): Terminated: ok {rc=0} 20:07:37.878878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Launched 20:07:38.215972 run osmo-hlr_10.42.42.2(pid=9793): Launched 20:07:38.345903 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:38.922804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Launched 20:07:39.259184 run osmo-stp_10.42.42.5(pid=9796): Launched 20:07:39.387473 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:39.993126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9798): Launched 20:07:40.328425 run osmo-msc_10.42.42.6(pid=9799): Launched 20:07:40.515802 run osmo-stp_10.42.42.5(pid=9796): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] 20:07:40.656585 run osmo-stp_10.42.42.5(pid=9796): stdout: | (launched: 2022-12-09_20:07:39.196668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:40.796566 run osmo-stp_10.42.42.5(pid=9796): stderr: | 20221209200739394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200739394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200739394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200739395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200739395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200739395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200739395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:40.935557 run osmo-stp_10.42.42.5(pid=9796): stdout: | (launched: 2022-12-09_20:07:39.196668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:41.068558 run osmo-stp_10.42.42.5(pid=9796): stderr: | 20221209200739394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200739394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200739394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200739395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200739395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200739395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200739395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:41.228384 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9796): Process ended prematurely: osmo-stp_10.42.42.5(pid=9796) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:07:41.238000 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:07:41.265841 run osmo-hlr_10.42.42.2(pid=9793): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9793)] 20:07:41.316707 run osmo-hlr_10.42.42.2(pid=9793): stdout: | (launched: 2022-12-09_20:07:38.153549) 20:07:41.369377 run osmo-hlr_10.42.42.2(pid=9793): stderr: | 20221209200738356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200738356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200738356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200738356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200738356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200738356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200738368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200738377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200738377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200738377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:41.442061 run osmo-msc_10.42.42.6(pid=9799): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9799)] 20:07:41.492463 run osmo-msc_10.42.42.6(pid=9799): stdout: | (launched: 2022-12-09_20:07:40.265442) 20:07:41.544563 run osmo-msc_10.42.42.6(pid=9799): stderr: | 20221209200740591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200740591 DLGLOBAL DEBUG validating counter group 0x7f1f396d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200740591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200740591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200740591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200740592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200740593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200740594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200740594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200740594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:41.597096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Terminating (SIGTERM) 20:07:41.639340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Terminating (SIGTERM) 20:07:41.681654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9798): Terminating (SIGTERM) 20:07:41.724032 --- ParallelTerminationStrategy: PID 9792 died... 20:07:41.744132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9792): Terminated: ok {rc=0} 20:07:41.790705 --- ParallelTerminationStrategy: PID 9795 died... 20:07:41.810355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9795): Terminated: ok {rc=0} 20:07:41.856659 --- ParallelTerminationStrategy: PID 9798 died... 20:07:41.876472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9798): Terminated: ok {rc=0} 20:07:41.968472 bus /sierra_3: Setting Powered False 20:07:43.067820 bus /sierra_3: Setting Powered False 20:07:44.184707 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:07:45.338216 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:45.350576 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:07:45.408709 tst mo_mt_call_osmux.py: using LAC 23413 20:07:45.540799 tst mo_mt_call_osmux.py: using RAC 208 20:07:45.671444 tst mo_mt_call_osmux.py: using CellId 23413 20:07:45.803784 tst mo_mt_call_osmux.py: using BVCI 23414 20:07:45.951839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:45.964215 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:45.977940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:45.991119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:46.003285 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:07:46.016274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:46.143060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:07:46.269642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:46.800344 run create_hlr_db(pid=9801): Launched 20:07:46.966960 bus /sierra_2: Setting Powered False 20:07:48.033627 run create_hlr_db(pid=9801): Terminated: ok {rc=0} 20:07:48.500430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9803): Launched 20:07:48.835834 run osmo-hlr_10.42.42.2(pid=9804): Launched 20:07:48.964342 run osmo-stp_10.42.42.5: Starting osmo-stp 20:07:49.540820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9806): Launched 20:07:49.877277 run osmo-stp_10.42.42.5(pid=9807): Launched 20:07:50.005602 run osmo-msc_10.42.42.6: Starting osmo-msc 20:07:50.610938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9809): Launched 20:07:50.945275 run osmo-msc_10.42.42.6(pid=9810): Launched 20:07:51.132533 run osmo-stp_10.42.42.5(pid=9807): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9807)] 20:07:51.272558 run osmo-stp_10.42.42.5(pid=9807): stdout: | (launched: 2022-12-09_20:07:49.814875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:51.413674 run osmo-stp_10.42.42.5(pid=9807): stderr: | 20221209200750012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200750012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200750012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200750013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200750015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200750015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200750015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:51.552582 run osmo-stp_10.42.42.5(pid=9807): stdout: | (launched: 2022-12-09_20:07:49.814875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:07:51.686209 run osmo-stp_10.42.42.5(pid=9807): stderr: | 20221209200750012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200750012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200750012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200750013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200750015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200750015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200750015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:07:51.845444 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9807): Process ended prematurely: osmo-stp_10.42.42.5(pid=9807) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9807)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:07:51.855253 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 20:07:51.883548 run osmo-hlr_10.42.42.2(pid=9804): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9804)] 20:07:51.934721 run osmo-hlr_10.42.42.2(pid=9804): stdout: | (launched: 2022-12-09_20:07:48.773244) 20:07:51.987472 run osmo-hlr_10.42.42.2(pid=9804): stderr: | 20221209200748976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200748976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200748976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200748976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200748976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200748976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200749010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200749020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200749020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200749021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:07:52.060893 run osmo-msc_10.42.42.6(pid=9810): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9810)] 20:07:52.111841 run osmo-msc_10.42.42.6(pid=9810): stdout: | (launched: 2022-12-09_20:07:50.882863) 20:07:52.164495 run osmo-msc_10.42.42.6(pid=9810): stderr: | 20221209200751209 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200751209 DLGLOBAL DEBUG validating counter group 0x7fc115fe4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200751209 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200751209 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200751210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200751210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200751211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200751212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200751212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200751212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:07:52.217305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9803): Terminating (SIGTERM) 20:07:52.259854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9806): Terminating (SIGTERM) 20:07:52.302261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9809): Terminating (SIGTERM) 20:07:52.345135 --- ParallelTerminationStrategy: PID 9803 died... 20:07:52.365447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9803): Terminated: ok {rc=0} 20:07:52.412222 --- ParallelTerminationStrategy: PID 9806 died... 20:07:52.432146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9806): Terminated: ok {rc=0} 20:07:52.478834 --- ParallelTerminationStrategy: PID 9809 died... 20:07:52.498719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9809): Terminated: ok {rc=0} 20:07:52.586748 bus /sierra_3: Setting Powered False 20:07:53.686015 bus /sierra_3: Setting Powered False 20:07:54.804199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:07:56.041714 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:07:56.048732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:07:56.070550 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:07:56.098114 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:07:56.155642 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:07:56.177416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:07:56.204815 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:07:56.757941 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:07:56.812905 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:56.824496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:07:56.881293 tst mo_mt_call.py: using LAC 23414 20:07:57.011340 tst mo_mt_call.py: using RAC 209 20:07:57.135608 tst mo_mt_call.py: using CellId 23414 20:07:57.258083 tst mo_mt_call.py: using BVCI 23415 20:07:57.374050 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:57.385274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:57.395962 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:57.407038 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:57.418144 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:07:57.429357 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:57.548776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:07:57.667642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:07:58.155528 run create_hlr_db(pid=9815): Launched 20:07:58.275856 bus /sierra_2: Setting Powered False 20:07:59.337224 run create_hlr_db(pid=9815): Terminated: ok {rc=0} 20:07:59.795466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Launched 20:08:00.132820 run osmo-hlr_10.42.42.2(pid=9818): Launched 20:08:00.260187 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:00.839140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Launched 20:08:01.186672 run osmo-stp_10.42.42.5(pid=9821): Launched 20:08:01.333658 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:02.108914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9832): Launched 20:08:02.517895 run osmo-msc_10.42.42.6(pid=9841): Launched 20:08:02.910878 run osmo-stp_10.42.42.5(pid=9821): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] 20:08:03.171374 run osmo-stp_10.42.42.5(pid=9821): stdout: | (launched: 2022-12-09_20:08:01.126800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:03.484473 run osmo-stp_10.42.42.5(pid=9821): stderr: | 20221209200801471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200801471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200801471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200801472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200801474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200801474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200801474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:03.649456 run osmo-stp_10.42.42.5(pid=9821): stdout: | (launched: 2022-12-09_20:08:01.126800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:03.810500 run osmo-stp_10.42.42.5(pid=9821): stderr: | 20221209200801471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200801471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200801471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200801472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200801474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200801474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200801474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:04.000884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9821): Process ended prematurely: osmo-stp_10.42.42.5(pid=9821) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:08:04.012482 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 20:08:04.049549 run osmo-hlr_10.42.42.2(pid=9818): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9818)] 20:08:04.113469 run osmo-hlr_10.42.42.2(pid=9818): stdout: | (launched: 2022-12-09_20:08:00.070581) 20:08:04.180026 run osmo-hlr_10.42.42.2(pid=9818): stderr: | 20221209200800272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200800272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200800272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200800272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200800272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200800272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200800288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200800299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200800299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200800299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:04.268459 run osmo-msc_10.42.42.6(pid=9841): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9841)] 20:08:04.332077 run osmo-msc_10.42.42.6(pid=9841): stdout: | (launched: 2022-12-09_20:08:02.454914) 20:08:04.396251 run osmo-msc_10.42.42.6(pid=9841): stderr: | 20221209200803082 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200803082 DLGLOBAL DEBUG validating counter group 0x7f380e129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200803082 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200803082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200803083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200803083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200803084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200803089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200803089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200803089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:04.462522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Terminating (SIGTERM) 20:08:04.523513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Terminating (SIGTERM) 20:08:04.591303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9832): Terminating (SIGTERM) 20:08:04.643206 --- ParallelTerminationStrategy: PID 9817 died... 20:08:04.669910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9817): Terminated: ok {rc=0} 20:08:04.727212 --- ParallelTerminationStrategy: PID 9820 died... 20:08:04.747676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9820): Terminated: ok {rc=0} 20:08:04.804350 --- ParallelTerminationStrategy: PID 9832 died... 20:08:04.826930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9832): Terminated: ok {rc=0} 20:08:04.936527 bus /sierra_3: Setting Powered False 20:08:06.044559 bus /sierra_3: Setting Powered False 20:08:07.163542 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:08:08.315362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.328252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:08:08.387346 tst mo_mt_call_osmux.py: using LAC 23415 20:08:08.513671 tst mo_mt_call_osmux.py: using RAC 210 20:08:08.641211 tst mo_mt_call_osmux.py: using CellId 23415 20:08:08.767760 tst mo_mt_call_osmux.py: using BVCI 23416 20:08:08.886958 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.899924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.911793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.924730 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.938703 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:08:08.950684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:08:09.075133 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:08:09.199133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:09.702391 run create_hlr_db(pid=10097): Launched 20:08:09.865826 bus /sierra_2: Setting Powered False 20:08:10.930046 run create_hlr_db(pid=10097): Terminated: ok {rc=0} 20:08:11.383669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Launched 20:08:11.722613 run osmo-hlr_10.42.42.2(pid=10100): Launched 20:08:11.968741 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:12.724285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Launched 20:08:13.064263 run osmo-stp_10.42.42.5(pid=10103): Launched 20:08:13.316468 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:14.066516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Launched 20:08:14.405117 run osmo-msc_10.42.42.6(pid=10106): Launched 20:08:14.773247 run osmo-stp_10.42.42.5(pid=10103): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] 20:08:15.057333 run osmo-stp_10.42.42.5(pid=10103): stdout: | (launched: 2022-12-09_20:08:13.002441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:15.336491 run osmo-stp_10.42.42.5(pid=10103): stderr: | 20221209200813339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200813339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200813339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200813339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200813340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200813340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200813340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:15.506694 run osmo-stp_10.42.42.5(pid=10103): stdout: | (launched: 2022-12-09_20:08:13.002441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:15.636809 run osmo-stp_10.42.42.5(pid=10103): stderr: | 20221209200813339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200813339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200813339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200813339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200813340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200813340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200813340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:15.793173 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10103): Process ended prematurely: osmo-stp_10.42.42.5(pid=10103) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:08:15.803669 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 20:08:15.845801 run osmo-hlr_10.42.42.2(pid=10100): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10100)] 20:08:15.899847 run osmo-hlr_10.42.42.2(pid=10100): stdout: | (launched: 2022-12-09_20:08:11.660128) 20:08:15.952596 run osmo-hlr_10.42.42.2(pid=10100): stderr: | 20221209200812009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200812009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200812009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200812009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200812009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200812009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200812030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200812042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200812043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200812043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:16.037298 run osmo-msc_10.42.42.6(pid=10106): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10106)] 20:08:16.088509 run osmo-msc_10.42.42.6(pid=10106): stdout: | (launched: 2022-12-09_20:08:14.344393) 20:08:16.142379 run osmo-msc_10.42.42.6(pid=10106): stderr: | 20221209200814949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200814949 DLGLOBAL DEBUG validating counter group 0x7fc1b095fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200814950 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200814950 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200814950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200814950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200814952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200814952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200814952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200814952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:16.195267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Terminating (SIGTERM) 20:08:16.254193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Terminating (SIGTERM) 20:08:16.319081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Terminating (SIGTERM) 20:08:16.370992 --- ParallelTerminationStrategy: PID 10099 died... 20:08:16.393705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10099): Terminated: ok {rc=0} 20:08:16.449335 --- ParallelTerminationStrategy: PID 10102 died... 20:08:16.472622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10102): Terminated: ok {rc=0} 20:08:16.528683 --- ParallelTerminationStrategy: PID 10105 died... 20:08:16.550977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10105): Terminated: ok {rc=0} 20:08:16.655018 bus /sierra_3: Setting Powered False 20:08:17.769063 bus /sierra_3: Setting Powered False 20:08:18.889742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:08:20.130052 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:20.136933 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:08:20.161769 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:08:20.191427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:08:20.248887 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:08:20.271224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:08:20.300493 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:08:20.842047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:08:20.899736 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:20.911892 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:08:20.969981 tst mo_mt_call.py: using LAC 23416 20:08:21.095281 tst mo_mt_call.py: using RAC 211 20:08:21.221559 tst mo_mt_call.py: using CellId 23416 20:08:21.347781 tst mo_mt_call.py: using BVCI 23417 20:08:21.466665 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:21.479045 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:21.490954 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:21.506019 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:21.518971 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:21.532679 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:21.658239 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:21.783328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:22.290067 run create_hlr_db(pid=10111): Launched 20:08:22.459271 bus /sierra_2: Setting Powered False 20:08:23.523811 run create_hlr_db(pid=10111): Terminated: ok {rc=0} 20:08:23.980028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10113): Launched 20:08:24.319985 run osmo-hlr_10.42.42.2(pid=10114): Launched 20:08:24.570842 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:25.180086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10117): Launched 20:08:25.517078 run osmo-stp_10.42.42.5(pid=10118): Launched 20:08:25.645396 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:26.251054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10120): Launched 20:08:26.588091 run osmo-msc_10.42.42.6(pid=10121): Launched 20:08:26.775816 run osmo-stp_10.42.42.5(pid=10118): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10118)] 20:08:26.916020 run osmo-stp_10.42.42.5(pid=10118): stdout: | (launched: 2022-12-09_20:08:25.454578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:27.056653 run osmo-stp_10.42.42.5(pid=10118): stderr: | 20221209200825649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200825649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200825649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200825650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200825650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200825650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200825650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:27.195661 run osmo-stp_10.42.42.5(pid=10118): stdout: | (launched: 2022-12-09_20:08:25.454578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:27.329201 run osmo-stp_10.42.42.5(pid=10118): stderr: | 20221209200825649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200825649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200825649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200825650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200825650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200825650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200825650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:27.489735 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10118): Process ended prematurely: osmo-stp_10.42.42.5(pid=10118) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10118)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:08:27.499324 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:08:27.527523 run osmo-hlr_10.42.42.2(pid=10114): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10114)] 20:08:27.578441 run osmo-hlr_10.42.42.2(pid=10114): stdout: | (launched: 2022-12-09_20:08:24.258219) 20:08:27.630682 run osmo-hlr_10.42.42.2(pid=10114): stderr: | 20221209200824614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200824614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200824614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200824614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200824614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200824614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200824636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200824645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200824645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200824645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:27.703736 run osmo-msc_10.42.42.6(pid=10121): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10121)] 20:08:27.754525 run osmo-msc_10.42.42.6(pid=10121): stdout: | (launched: 2022-12-09_20:08:26.525327) 20:08:27.806733 run osmo-msc_10.42.42.6(pid=10121): stderr: | 20221209200826850 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200826851 DLGLOBAL DEBUG validating counter group 0x7fb2025e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200826851 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200826851 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200826851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200826851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200826853 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200826853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200826853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200826853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:27.859863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10113): Terminating (SIGTERM) 20:08:27.901829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10117): Terminating (SIGTERM) 20:08:27.943823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10120): Terminating (SIGTERM) 20:08:27.986064 --- ParallelTerminationStrategy: PID 10113 died... 20:08:28.006236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10113): Terminated: ok {rc=0} 20:08:28.052616 --- ParallelTerminationStrategy: PID 10117 died... 20:08:28.072260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10117): Terminated: ok {rc=0} 20:08:28.118390 --- ParallelTerminationStrategy: PID 10120 died... 20:08:28.137983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10120): Terminated: ok {rc=0} 20:08:28.226758 bus /sierra_3: Setting Powered False 20:08:29.325845 bus /sierra_3: Setting Powered False 20:08:30.441537 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:08:31.596911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:31.610213 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:08:31.672168 tst mo_mt_call_osmux.py: using LAC 23417 20:08:31.804099 tst mo_mt_call_osmux.py: using RAC 212 20:08:31.959152 tst mo_mt_call_osmux.py: using CellId 23417 20:08:32.101709 tst mo_mt_call_osmux.py: using BVCI 23418 20:08:32.243927 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:32.256008 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:32.268167 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:32.280858 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:32.292613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:08:32.304457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:32.427429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:08:32.545938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:33.035064 run create_hlr_db(pid=10123): Launched 20:08:33.155974 bus /sierra_2: Setting Powered False 20:08:34.217239 run create_hlr_db(pid=10123): Terminated: ok {rc=0} 20:08:34.674817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10125): Launched 20:08:35.011620 run osmo-hlr_10.42.42.2(pid=10126): Launched 20:08:35.139847 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:35.717494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10128): Launched 20:08:36.053498 run osmo-stp_10.42.42.5(pid=10129): Launched 20:08:36.181688 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:36.787705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10131): Launched 20:08:37.125132 run osmo-msc_10.42.42.6(pid=10132): Launched 20:08:37.312659 run osmo-stp_10.42.42.5(pid=10129): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10129)] 20:08:37.453202 run osmo-stp_10.42.42.5(pid=10129): stdout: | (launched: 2022-12-09_20:08:35.990985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:37.594226 run osmo-stp_10.42.42.5(pid=10129): stderr: | 20221209200836187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200836187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200836187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200836188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200836188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200836188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200836189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:37.733386 run osmo-stp_10.42.42.5(pid=10129): stdout: | (launched: 2022-12-09_20:08:35.990985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:37.866585 run osmo-stp_10.42.42.5(pid=10129): stderr: | 20221209200836187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200836187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200836187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200836188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200836188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200836188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200836189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:38.025983 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10129): Process ended prematurely: osmo-stp_10.42.42.5(pid=10129) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10129)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:08:38.035766 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:08:38.063751 run osmo-hlr_10.42.42.2(pid=10126): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10126)] 20:08:38.114447 run osmo-hlr_10.42.42.2(pid=10126): stdout: | (launched: 2022-12-09_20:08:34.949042) 20:08:38.166846 run osmo-hlr_10.42.42.2(pid=10126): stderr: | 20221209200835152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200835152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200835152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200835152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200835152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200835152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200835199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200835209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200835209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200835210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:38.239578 run osmo-msc_10.42.42.6(pid=10132): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10132)] 20:08:38.290234 run osmo-msc_10.42.42.6(pid=10132): stdout: | (launched: 2022-12-09_20:08:37.062262) 20:08:38.343122 run osmo-msc_10.42.42.6(pid=10132): stderr: | 20221209200837389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200837389 DLGLOBAL DEBUG validating counter group 0x7f7fdce62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200837389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200837389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200837389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200837390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200837391 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200837392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200837392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200837392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:38.395834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10125): Terminating (SIGTERM) 20:08:38.438228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10128): Terminating (SIGTERM) 20:08:38.480578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10131): Terminating (SIGTERM) 20:08:38.523414 --- ParallelTerminationStrategy: PID 10125 died... 20:08:38.543652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10125): Terminated: ok {rc=0} 20:08:38.590205 --- ParallelTerminationStrategy: PID 10128 died... 20:08:38.610128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10128): Terminated: ok {rc=0} 20:08:38.656842 --- ParallelTerminationStrategy: PID 10131 died... 20:08:38.677056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10131): Terminated: ok {rc=0} 20:08:38.764895 bus /sierra_3: Setting Powered False 20:08:39.864747 bus /sierra_3: Setting Powered False 20:08:40.982675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:08:42.222900 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:08:42.229745 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:08:42.251757 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:08:42.278999 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:08:42.331353 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:08:42.352142 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:08:42.378453 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:08:42.928096 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:08:42.978172 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:42.989183 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:08:43.045878 tst mo_mt_call.py: using LAC 23418 20:08:43.168508 tst mo_mt_call.py: using RAC 213 20:08:43.292059 tst mo_mt_call.py: using CellId 23418 20:08:43.415968 tst mo_mt_call.py: using BVCI 23419 20:08:43.530870 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:43.541964 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:43.552726 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:43.564286 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:43.575360 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:43.586486 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:43.707595 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:43.826098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:44.310814 run create_hlr_db(pid=10138): Launched 20:08:44.431764 bus /sierra_2: Setting Powered False 20:08:45.493224 run create_hlr_db(pid=10138): Terminated: ok {rc=0} 20:08:45.969700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10140): Launched 20:08:46.316715 run osmo-hlr_10.42.42.2(pid=10141): Launched 20:08:46.521057 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:47.233623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10143): Launched 20:08:47.578240 run osmo-stp_10.42.42.5(pid=10144): Launched 20:08:47.705786 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:48.308913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10146): Launched 20:08:48.646356 run osmo-msc_10.42.42.6(pid=10147): Launched 20:08:48.834173 run osmo-stp_10.42.42.5(pid=10144): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10144)] 20:08:48.974488 run osmo-stp_10.42.42.5(pid=10144): stdout: | (launched: 2022-12-09_20:08:47.515353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:49.115483 run osmo-stp_10.42.42.5(pid=10144): stderr: | 20221209200847713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200847713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200847713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200847714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200847714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200847714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200847714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:49.254690 run osmo-stp_10.42.42.5(pid=10144): stdout: | (launched: 2022-12-09_20:08:47.515353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:49.388512 run osmo-stp_10.42.42.5(pid=10144): stderr: | 20221209200847713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200847713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200847713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200847714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200847714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200847714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200847714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:49.547915 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10144): Process ended prematurely: osmo-stp_10.42.42.5(pid=10144) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10144)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:08:49.557810 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:08:49.585814 run osmo-hlr_10.42.42.2(pid=10141): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10141)] 20:08:49.636513 run osmo-hlr_10.42.42.2(pid=10141): stdout: | (launched: 2022-12-09_20:08:46.255540) 20:08:49.688758 run osmo-hlr_10.42.42.2(pid=10141): stderr: | 20221209200846596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200846596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200846596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200846596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200846596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200846596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200846649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200846663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200846663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200846663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:08:49.761378 run osmo-msc_10.42.42.6(pid=10147): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10147)] 20:08:49.811758 run osmo-msc_10.42.42.6(pid=10147): stdout: | (launched: 2022-12-09_20:08:48.583688) 20:08:49.863716 run osmo-msc_10.42.42.6(pid=10147): stderr: | 20221209200848911 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200848911 DLGLOBAL DEBUG validating counter group 0x7f4ba8167c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200848912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200848912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200848912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200848912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200848914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200848914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200848914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200848914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:08:49.916322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10140): Terminating (SIGTERM) 20:08:49.958111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10143): Terminating (SIGTERM) 20:08:50.000126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10146): Terminating (SIGTERM) 20:08:50.042544 --- ParallelTerminationStrategy: PID 10140 died... 20:08:50.062855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10140): Terminated: ok {rc=0} 20:08:50.109405 --- ParallelTerminationStrategy: PID 10143 died... 20:08:50.129109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10143): Terminated: ok {rc=0} 20:08:50.175463 --- ParallelTerminationStrategy: PID 10146 died... 20:08:50.195162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10146): Terminated: ok {rc=0} 20:08:50.283268 bus /sierra_3: Setting Powered False 20:08:51.383459 bus /sierra_3: Setting Powered False 20:08:52.499013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:08:53.650990 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:53.663395 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:08:53.722218 tst mo_mt_call_osmux.py: using LAC 23419 20:08:53.854035 tst mo_mt_call_osmux.py: using RAC 214 20:08:53.984726 tst mo_mt_call_osmux.py: using CellId 23419 20:08:54.119727 tst mo_mt_call_osmux.py: using BVCI 23420 20:08:54.242669 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:54.254277 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:54.265660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:54.277028 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:54.288629 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:08:54.300061 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:54.421897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:08:54.542236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:08:55.064896 run create_hlr_db(pid=10149): Launched 20:08:55.202254 bus /sierra_2: Setting Powered False 20:08:56.268044 run create_hlr_db(pid=10149): Terminated: ok {rc=0} 20:08:56.717748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10151): Launched 20:08:57.035576 run osmo-hlr_10.42.42.2(pid=10152): Launched 20:08:57.156753 run osmo-stp_10.42.42.5: Starting osmo-stp 20:08:57.699794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10154): Launched 20:08:58.013910 run osmo-stp_10.42.42.5(pid=10155): Launched 20:08:58.132926 run osmo-msc_10.42.42.6: Starting osmo-msc 20:08:58.701707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10157): Launched 20:08:59.015653 run osmo-msc_10.42.42.6(pid=10158): Launched 20:08:59.191689 run osmo-stp_10.42.42.5(pid=10155): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10155)] 20:08:59.323532 run osmo-stp_10.42.42.5(pid=10155): stdout: | (launched: 2022-12-09_20:08:57.954915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:59.455242 run osmo-stp_10.42.42.5(pid=10155): stderr: | 20221209200858129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200858129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200858130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200858130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200858132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200858132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200858133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:59.584683 run osmo-stp_10.42.42.5(pid=10155): stdout: | (launched: 2022-12-09_20:08:57.954915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:08:59.709256 run osmo-stp_10.42.42.5(pid=10155): stderr: | 20221209200858129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200858129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200858130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200858130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200858132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200858132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200858133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:08:59.858220 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10155): Process ended prematurely: osmo-stp_10.42.42.5(pid=10155) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10155)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:08:59.867219 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:08:59.893936 run osmo-hlr_10.42.42.2(pid=10152): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10152)] 20:08:59.942426 run osmo-hlr_10.42.42.2(pid=10152): stdout: | (launched: 2022-12-09_20:08:56.976136) 20:08:59.992404 run osmo-hlr_10.42.42.2(pid=10152): stderr: | 20221209200857157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200857157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200857157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200857157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200857158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200857158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200857170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200857181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200857181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200857181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:00.061949 run osmo-msc_10.42.42.6(pid=10158): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10158)] 20:09:00.110251 run osmo-msc_10.42.42.6(pid=10158): stdout: | (launched: 2022-12-09_20:08:58.956658) 20:09:00.160193 run osmo-msc_10.42.42.6(pid=10158): stderr: | 20221209200859232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200859233 DLGLOBAL DEBUG validating counter group 0x7f3dea1cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200859233 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200859233 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200859233 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200859233 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200859235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200859235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200859235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200859236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:00.210421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10151): Terminating (SIGTERM) 20:09:00.250091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10154): Terminating (SIGTERM) 20:09:00.289898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10157): Terminating (SIGTERM) 20:09:00.329890 --- ParallelTerminationStrategy: PID 10151 died... 20:09:00.348882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10151): Terminated: ok {rc=0} 20:09:00.392822 --- ParallelTerminationStrategy: PID 10154 died... 20:09:00.411128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10154): Terminated: ok {rc=0} 20:09:00.455580 --- ParallelTerminationStrategy: PID 10157 died... 20:09:00.473830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10157): Terminated: ok {rc=0} 20:09:00.559861 bus /sierra_3: Setting Powered False 20:09:01.666340 bus /sierra_3: Setting Powered False 20:09:02.798745 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:09:04.038079 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:04.045104 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:09:04.066844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:09:04.095151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:09:04.148192 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:09:04.169707 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:09:04.196910 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:09:04.748656 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:09:04.801771 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:04.813472 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:09:04.870507 tst mo_mt_call.py: using LAC 23420 20:09:05.001384 tst mo_mt_call.py: using RAC 215 20:09:05.131342 tst mo_mt_call.py: using CellId 23420 20:09:05.260677 tst mo_mt_call.py: using BVCI 23421 20:09:05.383608 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:05.395201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:05.406574 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:05.417912 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:05.429361 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:05.440702 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:05.559007 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:05.676047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:06.160694 run create_hlr_db(pid=10164): Launched 20:09:06.282389 bus /sierra_2: Setting Powered False 20:09:07.344066 run create_hlr_db(pid=10164): Terminated: ok {rc=0} 20:09:07.802498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Launched 20:09:08.139503 run osmo-hlr_10.42.42.2(pid=10167): Launched 20:09:08.269486 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:08.851245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Launched 20:09:09.188260 run osmo-stp_10.42.42.5(pid=10170): Launched 20:09:09.317328 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:09.923025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Launched 20:09:10.258674 run osmo-msc_10.42.42.6(pid=10173): Launched 20:09:10.445365 run osmo-stp_10.42.42.5(pid=10170): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] 20:09:10.586014 run osmo-stp_10.42.42.5(pid=10170): stdout: | (launched: 2022-12-09_20:09:09.125813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:10.726476 run osmo-stp_10.42.42.5(pid=10170): stderr: | 20221209200909323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200909323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200909323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200909324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200909324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200909324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200909324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:10.865539 run osmo-stp_10.42.42.5(pid=10170): stdout: | (launched: 2022-12-09_20:09:09.125813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:10.998636 run osmo-stp_10.42.42.5(pid=10170): stderr: | 20221209200909323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200909323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200909323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200909324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200909324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200909324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200909324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:11.157844 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10170): Process ended prematurely: osmo-stp_10.42.42.5(pid=10170) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:09:11.167417 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:09:11.194960 run osmo-hlr_10.42.42.2(pid=10167): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10167)] 20:09:11.244786 run osmo-hlr_10.42.42.2(pid=10167): stdout: | (launched: 2022-12-09_20:09:08.077096) 20:09:11.296367 run osmo-hlr_10.42.42.2(pid=10167): stderr: | 20221209200908278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200908278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200908279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200908279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200908279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200908279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200908291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200908301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200908301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200908301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:11.368453 run osmo-msc_10.42.42.6(pid=10173): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10173)] 20:09:11.418425 run osmo-msc_10.42.42.6(pid=10173): stdout: | (launched: 2022-12-09_20:09:10.195557) 20:09:11.469746 run osmo-msc_10.42.42.6(pid=10173): stderr: | 20221209200910523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200910523 DLGLOBAL DEBUG validating counter group 0x7fdad5389c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200910524 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200910524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200910524 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200910524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200910526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200910526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200910526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200910526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:11.521988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Terminating (SIGTERM) 20:09:11.563586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Terminating (SIGTERM) 20:09:11.605066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Terminating (SIGTERM) 20:09:11.646751 --- ParallelTerminationStrategy: PID 10166 died... 20:09:11.666576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10166): Terminated: ok {rc=0} 20:09:11.712375 --- ParallelTerminationStrategy: PID 10169 died... 20:09:11.731930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10169): Terminated: ok {rc=0} 20:09:11.778543 --- ParallelTerminationStrategy: PID 10172 died... 20:09:11.798270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10172): Terminated: ok {rc=0} 20:09:11.886617 bus /sierra_3: Setting Powered False 20:09:12.987992 bus /sierra_3: Setting Powered False 20:09:14.106070 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:09:15.253831 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.265632 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:09:15.322407 tst mo_mt_call_osmux.py: using LAC 23421 20:09:15.444906 tst mo_mt_call_osmux.py: using RAC 216 20:09:15.566254 tst mo_mt_call_osmux.py: using CellId 23421 20:09:15.690234 tst mo_mt_call_osmux.py: using BVCI 23422 20:09:15.805502 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.816499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.827582 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.844588 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.856136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:09:15.867897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:15.991021 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:09:16.135461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:16.697345 run create_hlr_db(pid=10175): Launched 20:09:16.852151 bus /sierra_2: Setting Powered False 20:09:17.912580 run create_hlr_db(pid=10175): Terminated: ok {rc=0} 20:09:18.371036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Launched 20:09:18.707772 run osmo-hlr_10.42.42.2(pid=10178): Launched 20:09:18.835529 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:19.412927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Launched 20:09:19.749391 run osmo-stp_10.42.42.5(pid=10181): Launched 20:09:19.877857 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:20.482523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Launched 20:09:20.817288 run osmo-msc_10.42.42.6(pid=10184): Launched 20:09:21.005715 run osmo-stp_10.42.42.5(pid=10181): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] 20:09:21.145947 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-09_20:09:19.686797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:21.286562 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221209200919882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200919882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200919883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200919883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200919883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200919884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200919884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:21.426164 run osmo-stp_10.42.42.5(pid=10181): stdout: | (launched: 2022-12-09_20:09:19.686797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:21.559272 run osmo-stp_10.42.42.5(pid=10181): stderr: | 20221209200919882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200919882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200919883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200919883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200919883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200919884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200919884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:21.718536 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:09:21.728221 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:09:21.756296 run osmo-hlr_10.42.42.2(pid=10178): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10178)] 20:09:21.806743 run osmo-hlr_10.42.42.2(pid=10178): stdout: | (launched: 2022-12-09_20:09:18.645101) 20:09:21.858452 run osmo-hlr_10.42.42.2(pid=10178): stderr: | 20221209200918848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200918848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200918848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200918848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200918848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200918848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200918864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200918874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200918874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200918874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:21.930148 run osmo-msc_10.42.42.6(pid=10184): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10184)] 20:09:21.980034 run osmo-msc_10.42.42.6(pid=10184): stdout: | (launched: 2022-12-09_20:09:20.754778) 20:09:22.031635 run osmo-msc_10.42.42.6(pid=10184): stderr: | 20221209200921081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200921081 DLGLOBAL DEBUG validating counter group 0x7f0846062c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200921081 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200921081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200921081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200921082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200921083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200921084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200921084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200921084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:22.083718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminating (SIGTERM) 20:09:22.125387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminating (SIGTERM) 20:09:22.167029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Terminating (SIGTERM) 20:09:22.208917 --- ParallelTerminationStrategy: PID 10177 died... 20:09:22.228827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10177): Terminated: ok {rc=0} 20:09:22.274962 --- ParallelTerminationStrategy: PID 10180 died... 20:09:22.294604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10180): Terminated: ok {rc=0} 20:09:22.340706 --- ParallelTerminationStrategy: PID 10183 died... 20:09:22.360683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10183): Terminated: ok {rc=0} 20:09:22.447373 bus /sierra_3: Setting Powered False 20:09:23.546861 bus /sierra_3: Setting Powered False 20:09:24.665852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:09:25.898768 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:25.906357 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:09:25.927843 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:09:25.955597 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:09:26.010864 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:09:26.032581 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:09:26.060075 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:09:26.610051 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:09:26.664102 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:26.675655 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:09:26.734434 tst mo_mt_call.py: using LAC 23422 20:09:26.868463 tst mo_mt_call.py: using RAC 217 20:09:26.998704 tst mo_mt_call.py: using CellId 23422 20:09:27.127644 tst mo_mt_call.py: using BVCI 23423 20:09:27.250281 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:27.261972 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:27.273433 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:27.284687 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:27.296101 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:27.307651 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:27.430545 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:27.548531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:28.036226 run create_hlr_db(pid=10189): Launched 20:09:28.156301 bus /sierra_2: Setting Powered False 20:09:29.218728 run create_hlr_db(pid=10189): Terminated: ok {rc=0} 20:09:29.678420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10191): Launched 20:09:30.014909 run osmo-hlr_10.42.42.2(pid=10192): Launched 20:09:30.144415 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:30.721513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10194): Launched 20:09:31.082509 run osmo-stp_10.42.42.5(pid=10195): Launched 20:09:31.335758 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:32.036724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10197): Launched 20:09:32.368445 run osmo-msc_10.42.42.6(pid=10198): Launched 20:09:32.546355 run osmo-stp_10.42.42.5(pid=10195): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10195)] 20:09:32.681193 run osmo-stp_10.42.42.5(pid=10195): stdout: | (launched: 2022-12-09_20:09:31.019117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:32.813720 run osmo-stp_10.42.42.5(pid=10195): stderr: | 20221209200931318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200931318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200931318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200931319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200931319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200931319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200931319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:32.944468 run osmo-stp_10.42.42.5(pid=10195): stdout: | (launched: 2022-12-09_20:09:31.019117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:33.069882 run osmo-stp_10.42.42.5(pid=10195): stderr: | 20221209200931318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200931318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200931318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200931319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200931319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200931319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200931319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:33.219173 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10195): Process ended prematurely: osmo-stp_10.42.42.5(pid=10195) [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10195)] [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:09:33.228219 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:09:33.255020 run osmo-hlr_10.42.42.2(pid=10192): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10192)] 20:09:33.302999 run osmo-hlr_10.42.42.2(pid=10192): stdout: | (launched: 2022-12-09_20:09:29.952038) 20:09:33.352863 run osmo-hlr_10.42.42.2(pid=10192): stderr: | 20221209200930156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200930156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200930156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200930156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200930156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200930156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200930168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200930177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200930178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200930178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:33.422271 run osmo-msc_10.42.42.6(pid=10198): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10198)] 20:09:33.470194 run osmo-msc_10.42.42.6(pid=10198): stdout: | (launched: 2022-12-09_20:09:32.309301) 20:09:33.519928 run osmo-msc_10.42.42.6(pid=10198): stderr: | 20221209200932582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200932582 DLGLOBAL DEBUG validating counter group 0x7fb3f7ff8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200932582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200932582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200932582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200932582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200932584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200932584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200932585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200932585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:33.570416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10191): Terminating (SIGTERM) 20:09:33.610562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10194): Terminating (SIGTERM) 20:09:33.650233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10197): Terminating (SIGTERM) 20:09:33.690150 --- ParallelTerminationStrategy: PID 10191 died... 20:09:33.709209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10191): Terminated: ok {rc=0} 20:09:33.753529 --- ParallelTerminationStrategy: PID 10194 died... 20:09:33.772011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10194): Terminated: ok {rc=0} 20:09:33.816807 --- ParallelTerminationStrategy: PID 10197 died... 20:09:33.836032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10197): Terminated: ok {rc=0} 20:09:33.922939 bus /sierra_3: Setting Powered False 20:09:35.023166 bus /sierra_3: Setting Powered False 20:09:36.140573 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:09:37.289141 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.301135 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:09:37.361207 tst mo_mt_call_osmux.py: using LAC 23423 20:09:37.494790 tst mo_mt_call_osmux.py: using RAC 218 20:09:37.625076 tst mo_mt_call_osmux.py: using CellId 23423 20:09:37.746828 tst mo_mt_call_osmux.py: using BVCI 23424 20:09:37.861926 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.873196 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.884097 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.895314 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.906590 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:09:37.917831 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:38.038432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:09:38.157627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:38.644042 run create_hlr_db(pid=10200): Launched 20:09:38.764059 bus /sierra_2: Setting Powered False 20:09:39.826583 run create_hlr_db(pid=10200): Terminated: ok {rc=0} 20:09:40.283935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10202): Launched 20:09:40.622872 run osmo-hlr_10.42.42.2(pid=10203): Launched 20:09:40.750411 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:41.331078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10206): Launched 20:09:41.666484 run osmo-stp_10.42.42.5(pid=10207): Launched 20:09:41.793337 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:42.397907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10209): Launched 20:09:42.734167 run osmo-msc_10.42.42.6(pid=10210): Launched 20:09:42.919877 run osmo-stp_10.42.42.5(pid=10207): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10207)] 20:09:43.059749 run osmo-stp_10.42.42.5(pid=10207): stdout: | (launched: 2022-12-09_20:09:41.603817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:43.200628 run osmo-stp_10.42.42.5(pid=10207): stderr: | 20221209200941799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200941799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200941800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200941800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200941801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200941801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200941801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:43.339839 run osmo-stp_10.42.42.5(pid=10207): stdout: | (launched: 2022-12-09_20:09:41.603817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:43.473439 run osmo-stp_10.42.42.5(pid=10207): stderr: | 20221209200941799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200941799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200941800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200941800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200941801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200941801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200941801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:43.632405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10207): Process ended prematurely: osmo-stp_10.42.42.5(pid=10207) [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10207)] [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:09:43.642391 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:09:43.670223 run osmo-hlr_10.42.42.2(pid=10203): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10203)] 20:09:43.720180 run osmo-hlr_10.42.42.2(pid=10203): stdout: | (launched: 2022-12-09_20:09:40.559771) 20:09:43.771806 run osmo-hlr_10.42.42.2(pid=10203): stderr: | 20221209200940764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200940764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200940764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200940764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200940764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200940764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200940777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200940786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200940786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200940786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:43.843675 run osmo-msc_10.42.42.6(pid=10210): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10210)] 20:09:43.893557 run osmo-msc_10.42.42.6(pid=10210): stdout: | (launched: 2022-12-09_20:09:42.671574) 20:09:43.945257 run osmo-msc_10.42.42.6(pid=10210): stderr: | 20221209200942999 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200942999 DLGLOBAL DEBUG validating counter group 0x7ff7396bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200943000 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200943000 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200943000 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200943000 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200943002 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200943002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200943002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200943002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:43.996793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10202): Terminating (SIGTERM) 20:09:44.038246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10206): Terminating (SIGTERM) 20:09:44.079722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10209): Terminating (SIGTERM) 20:09:44.121704 --- ParallelTerminationStrategy: PID 10202 died... 20:09:44.141669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10202): Terminated: ok {rc=0} 20:09:44.187569 --- ParallelTerminationStrategy: PID 10206 died... 20:09:44.207119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10206): Terminated: ok {rc=0} 20:09:44.253446 --- ParallelTerminationStrategy: PID 10209 died... 20:09:44.273017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10209): Terminated: ok {rc=0} 20:09:44.361848 bus /sierra_3: Setting Powered False 20:09:45.460565 bus /sierra_3: Setting Powered False 20:09:46.590177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:09:47.829675 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:09:47.835156 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:09:47.855930 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:09:47.882345 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:09:47.935948 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:09:47.956761 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:09:47.983384 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:09:48.531876 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:09:48.582583 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:48.593577 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:48.650744 tst mo_mt_call.py: using LAC 23424 20:09:48.777702 tst mo_mt_call.py: using RAC 219 20:09:48.900724 tst mo_mt_call.py: using CellId 23424 20:09:49.021622 tst mo_mt_call.py: using BVCI 23425 20:09:49.137141 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:49.148068 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:49.158757 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:49.169809 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:49.180773 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:49.191963 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:49.310653 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:49.431247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:09:49.917749 run create_hlr_db(pid=10217): Launched 20:09:50.037411 bus /sierra_2: Setting Powered False 20:09:51.099545 run create_hlr_db(pid=10217): Terminated: ok {rc=0} 20:09:51.558650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10219): Launched 20:09:51.894911 run osmo-hlr_10.42.42.2(pid=10220): Launched 20:09:52.023038 run osmo-stp_10.42.42.5: Starting osmo-stp 20:09:52.602822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10222): Launched 20:09:52.939827 run osmo-stp_10.42.42.5(pid=10223): Launched 20:09:53.068268 run osmo-msc_10.42.42.6: Starting osmo-msc 20:09:53.675977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10225): Launched 20:09:54.012079 run osmo-msc_10.42.42.6(pid=10226): Launched 20:09:54.199789 run osmo-stp_10.42.42.5(pid=10223): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10223)] 20:09:54.340338 run osmo-stp_10.42.42.5(pid=10223): stdout: | (launched: 2022-12-09_20:09:52.877383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:54.483109 run osmo-stp_10.42.42.5(pid=10223): stderr: | 20221209200953074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200953074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200953074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200953075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200953075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200953075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200953075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:54.623304 run osmo-stp_10.42.42.5(pid=10223): stdout: | (launched: 2022-12-09_20:09:52.877383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:09:54.756701 run osmo-stp_10.42.42.5(pid=10223): stderr: | 20221209200953074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209200953074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209200953074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209200953075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209200953075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209200953075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209200953075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:09:54.916546 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10223): Process ended prematurely: osmo-stp_10.42.42.5(pid=10223) [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10223)] [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:09:54.926557 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:09:54.954226 run osmo-hlr_10.42.42.2(pid=10220): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10220)] 20:09:55.004417 run osmo-hlr_10.42.42.2(pid=10220): stdout: | (launched: 2022-12-09_20:09:51.832596) 20:09:55.056710 run osmo-hlr_10.42.42.2(pid=10220): stderr: | 20221209200952036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209200952036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209200952036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209200952036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209200952036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209200952036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209200952048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209200952057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209200952057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209200952057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:09:55.128901 run osmo-msc_10.42.42.6(pid=10226): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10226)] 20:09:55.178906 run osmo-msc_10.42.42.6(pid=10226): stdout: | (launched: 2022-12-09_20:09:53.949394) 20:09:55.231039 run osmo-msc_10.42.42.6(pid=10226): stderr: | 20221209200954276 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209200954276 DLGLOBAL DEBUG validating counter group 0x7fc21c62fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209200954276 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209200954276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209200954277 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209200954277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209200954279 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209200954279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209200954279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209200954279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:09:55.283163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10219): Terminating (SIGTERM) 20:09:55.324939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10222): Terminating (SIGTERM) 20:09:55.366797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10225): Terminating (SIGTERM) 20:09:55.408796 --- ParallelTerminationStrategy: PID 10219 died... 20:09:55.428890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10219): Terminated: ok {rc=0} 20:09:55.475385 --- ParallelTerminationStrategy: PID 10222 died... 20:09:55.494964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10222): Terminated: ok {rc=0} 20:09:55.541020 --- ParallelTerminationStrategy: PID 10225 died... 20:09:55.560606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10225): Terminated: ok {rc=0} 20:09:55.648702 bus /sierra_3: Setting Powered False 20:09:56.748812 bus /sierra_3: Setting Powered False 20:09:57.866182 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:09:59.017850 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.029972 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:09:59.089498 tst mo_mt_call_osmux.py: using LAC 23425 20:09:59.222471 tst mo_mt_call_osmux.py: using RAC 220 20:09:59.353697 tst mo_mt_call_osmux.py: using CellId 23425 20:09:59.485423 tst mo_mt_call_osmux.py: using BVCI 23426 20:09:59.607346 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.618925 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.630153 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.641389 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.652508 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:09:59.663876 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:59.785660 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:09:59.902777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:00.390740 run create_hlr_db(pid=10228): Launched 20:10:00.511650 bus /sierra_2: Setting Powered False 20:10:01.578273 run create_hlr_db(pid=10228): Terminated: ok {rc=0} 20:10:02.051489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Launched 20:10:02.390417 run osmo-hlr_10.42.42.2(pid=10234): Launched 20:10:02.519102 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:03.098027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Launched 20:10:03.434578 run osmo-stp_10.42.42.5(pid=10237): Launched 20:10:03.563728 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:04.168008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10239): Launched 20:10:04.507030 run osmo-msc_10.42.42.6(pid=10240): Launched 20:10:04.689666 run osmo-stp_10.42.42.5(pid=10237): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] 20:10:04.827521 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-09_20:10:03.371466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:04.965941 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221209201003567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201003567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201003567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201003568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201003570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201003570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201003570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:05.102497 run osmo-stp_10.42.42.5(pid=10237): stdout: | (launched: 2022-12-09_20:10:03.371466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:05.232483 run osmo-stp_10.42.42.5(pid=10237): stderr: | 20221209201003567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201003567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201003567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201003568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201003570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201003570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201003570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:05.388691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:10:05.398509 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:10:05.426477 run osmo-hlr_10.42.42.2(pid=10234): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10234)] 20:10:05.476614 run osmo-hlr_10.42.42.2(pid=10234): stdout: | (launched: 2022-12-09_20:10:02.327480) 20:10:05.528581 run osmo-hlr_10.42.42.2(pid=10234): stderr: | 20221209201002528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201002528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201002528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201002528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201002528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201002528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201002541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201002549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201002550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201002550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:05.600605 run osmo-msc_10.42.42.6(pid=10240): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10240)] 20:10:05.650335 run osmo-msc_10.42.42.6(pid=10240): stdout: | (launched: 2022-12-09_20:10:04.444910) 20:10:05.701391 run osmo-msc_10.42.42.6(pid=10240): stderr: | 20221209201004772 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201004773 DLGLOBAL DEBUG validating counter group 0x7f22eaed9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201004773 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201004773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201004773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201004773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201004775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201004775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201004775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201004775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:05.752566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminating (SIGTERM) 20:10:05.793816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminating (SIGTERM) 20:10:05.834945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10239): Terminating (SIGTERM) 20:10:05.876239 --- ParallelTerminationStrategy: PID 10233 died... 20:10:05.895898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10233): Terminated: ok {rc=0} 20:10:05.941461 --- ParallelTerminationStrategy: PID 10236 died... 20:10:05.961245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10236): Terminated: ok {rc=0} 20:10:06.007128 --- ParallelTerminationStrategy: PID 10239 died... 20:10:06.026468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10239): Terminated: ok {rc=0} 20:10:06.114158 bus /sierra_3: Setting Powered False 20:10:07.213679 bus /sierra_3: Setting Powered False 20:10:08.330887 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:sysmo --------------------------------------------------------------------- 20:10:09.560646 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:09.565233 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 20:10:09.585570 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 20:10:09.611985 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 20:10:09.697593 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 20:10:09.718099 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 20:10:09.745808 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 20:10:10.326855 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 20:10:10.331751 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.342302 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:10:10.380246 tst emergency_mo_mt_call.py: using LAC 23426 20:10:10.503926 tst emergency_mo_mt_call.py: using RAC 221 20:10:10.621730 tst emergency_mo_mt_call.py: using CellId 23426 20:10:10.748511 tst emergency_mo_mt_call.py: using BVCI 23427 20:10:10.866667 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.877732 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.888715 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.899583 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.910623 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:10.921575 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:11.038051 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:11.153392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:11.619863 run create_hlr_db(pid=10245): Launched 20:10:11.734494 bus /sierra_2: Setting Powered False 20:10:12.793955 run create_hlr_db(pid=10245): Terminated: ok {rc=0} 20:10:13.236011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10247): Launched 20:10:13.560187 run osmo-hlr_10.42.42.2(pid=10248): Launched 20:10:13.683259 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:14.242547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10250): Launched 20:10:14.565886 run osmo-stp_10.42.42.5(pid=10251): Launched 20:10:14.699794 tst emergency_mo_mt_call.py: using MSISDN 7362 20:10:14.864719 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:15.445384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10253): Launched 20:10:15.767073 run osmo-msc_10.42.42.6(pid=10254): Launched 20:10:16.065566 run osmo-stp_10.42.42.5(pid=10251): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10251)] 20:10:16.284914 run osmo-stp_10.42.42.5(pid=10251): stdout: | (launched: 2022-12-09_20:10:14.505154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:16.583722 run osmo-stp_10.42.42.5(pid=10251): stderr: | 20221209201014701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201014701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201014701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201014701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201014702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201014702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201014702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:16.720310 run osmo-stp_10.42.42.5(pid=10251): stdout: | (launched: 2022-12-09_20:10:14.505154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:16.851404 run osmo-stp_10.42.42.5(pid=10251): stderr: | 20221209201014701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201014701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201014701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201014701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201014702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201014702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201014702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:17.007885 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10251): Process ended prematurely: osmo-stp_10.42.42.5(pid=10251) [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10251)] [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py:19] 20:10:17.017930 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 20:10:17.047398 run osmo-hlr_10.42.42.2(pid=10248): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10248)] 20:10:17.099770 run osmo-hlr_10.42.42.2(pid=10248): stdout: | (launched: 2022-12-09_20:10:13.499497) 20:10:17.153284 run osmo-hlr_10.42.42.2(pid=10248): stderr: | 20221209201013701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201013701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201013701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201013701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201013701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201013701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201013714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201013722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201013723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201013723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:17.227533 run osmo-msc_10.42.42.6(pid=10254): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10254)] 20:10:17.279649 run osmo-msc_10.42.42.6(pid=10254): stdout: | (launched: 2022-12-09_20:10:15.706464) 20:10:17.333170 run osmo-msc_10.42.42.6(pid=10254): stderr: | 20221209201016146 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201016147 DLGLOBAL DEBUG validating counter group 0x7f3db56bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201016147 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201016147 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201016147 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201016155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201016161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201016161 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201016161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201016161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:17.387864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10247): Terminating (SIGTERM) 20:10:17.430826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10250): Terminating (SIGTERM) 20:10:17.472805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10253): Terminating (SIGTERM) 20:10:17.515381 --- ParallelTerminationStrategy: PID 10247 died... 20:10:17.535499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10247): Terminated: ok {rc=0} 20:10:17.581977 --- ParallelTerminationStrategy: PID 10250 died... 20:10:17.601615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10250): Terminated: ok {rc=0} 20:10:17.647743 --- ParallelTerminationStrategy: PID 10253 died... 20:10:17.667396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10253): Terminated: ok {rc=0} 20:10:17.755070 bus /sierra_3: Setting Powered False 20:10:18.853629 bus /sierra_3: Setting Powered False 20:10:19.969361 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 20:10:21.054383 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.065746 tst emergency:sysmo: Using 1 x bts (candidates: 1) 20:10:21.103243 tst emergency_preemptive_call.py: using LAC 23427 20:10:21.227274 tst emergency_preemptive_call.py: using RAC 222 20:10:21.343858 tst emergency_preemptive_call.py: using CellId 23427 20:10:21.460684 tst emergency_preemptive_call.py: using BVCI 23428 20:10:21.568662 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.579314 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.589860 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.600405 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.611110 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 20:10:21.621754 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:21.742625 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:21.863864 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:21.980406 tst emergency:sysmo: Using 1 x modem (candidates: 4) 20:10:22.101157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:22.600554 run create_hlr_db(pid=10256): Launched 20:10:22.731421 bus /sierra_2: Setting Powered False 20:10:23.794925 run create_hlr_db(pid=10256): Terminated: ok {rc=0} 20:10:24.223336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Launched 20:10:24.525199 run osmo-hlr_10.42.42.2(pid=10259): Launched 20:10:24.640643 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:25.168030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Launched 20:10:25.469802 run osmo-stp_10.42.42.5(pid=10262): Launched 20:10:25.594540 tst emergency_preemptive_call.py: using MSISDN 7363 20:10:25.747145 run osmo-msc_10.42.42.6: Starting osmo-msc 20:10:26.284399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10264): Launched 20:10:26.585429 run osmo-msc_10.42.42.6(pid=10265): Launched 20:10:26.760698 run osmo-stp_10.42.42.5(pid=10262): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] 20:10:26.888194 run osmo-stp_10.42.42.5(pid=10262): stdout: | (launched: 2022-12-09_20:10:25.412262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:27.015281 run osmo-stp_10.42.42.5(pid=10262): stderr: | 20221209201025584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201025584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201025584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201025585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201025585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201025585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201025585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:27.139852 run osmo-stp_10.42.42.5(pid=10262): stdout: | (launched: 2022-12-09_20:10:25.412262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:27.259424 run osmo-stp_10.42.42.5(pid=10262): stderr: | 20221209201025584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201025584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201025584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201025585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201025585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201025585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201025585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:27.401979 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10262): Process ended prematurely: osmo-stp_10.42.42.5(pid=10262) [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py:32] 20:10:27.410230 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 20:10:27.436066 run osmo-hlr_10.42.42.2(pid=10259): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10259)] 20:10:27.483576 run osmo-hlr_10.42.42.2(pid=10259): stdout: | (launched: 2022-12-09_20:10:24.468294) 20:10:27.532306 run osmo-hlr_10.42.42.2(pid=10259): stderr: | 20221209201024646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201024647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201024647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201024647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201024647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201024647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201024659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201024670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201024671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201024671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:27.600414 run osmo-msc_10.42.42.6(pid=10265): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10265)] 20:10:27.647275 run osmo-msc_10.42.42.6(pid=10265): stdout: | (launched: 2022-12-09_20:10:26.528165) 20:10:27.695972 run osmo-msc_10.42.42.6(pid=10265): stderr: | 20221209201026801 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201026801 DLGLOBAL DEBUG validating counter group 0x7f4362e80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201026801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201026801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201026802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201026802 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201026805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201026806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201026806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201026806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:10:27.745721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Terminating (SIGTERM) 20:10:27.784935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Terminating (SIGTERM) 20:10:27.824304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10264): Terminating (SIGTERM) 20:10:27.863785 --- ParallelTerminationStrategy: PID 10258 died... 20:10:27.882545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Terminated: ok {rc=0} 20:10:27.926027 --- ParallelTerminationStrategy: PID 10261 died... 20:10:27.944066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Terminated: ok {rc=0} 20:10:27.988230 --- ParallelTerminationStrategy: PID 10264 died... 20:10:28.006492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10264): Terminated: ok {rc=0} 20:10:28.089167 bus /sierra_9: Setting Powered False 20:10:29.183808 bus /sierra_9: Setting Powered False 20:10:30.296937 bus /sierra_8: Setting Powered False 20:10:31.400096 bus /sierra_8: Setting Powered False 20:10:32.518806 bus /sierra_3: Setting Powered False 20:10:33.612909 bus /sierra_3: Setting Powered False 20:10:34.724537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:sysmo --------------------------------------------------------------------- 20:10:35.979223 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:10:35.983734 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 20:10:36.003901 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 20:10:36.042411 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 20:10:36.127925 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 20:10:36.148236 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 20:10:36.186315 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 20:10:36.774546 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 20:10:36.825218 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:36.835518 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:10:36.870343 tst cs_paging_gprs_active.py: using LAC 23428 20:10:36.991678 tst cs_paging_gprs_active.py: using RAC 223 20:10:37.110433 tst cs_paging_gprs_active.py: using CellId 23428 20:10:37.232358 tst cs_paging_gprs_active.py: using BVCI 23429 20:10:37.351751 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.362849 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.373872 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.385194 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.395862 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.406581 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.417435 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.428135 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:37.439137 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:37.553493 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:37.674571 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:10:37.894942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:38.222164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Launched 20:10:38.504497 run iperf3-srv_10.42.42.10(pid=10271): Launched 20:10:38.625568 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:10:38.843731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:39.168730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Launched 20:10:39.451010 run iperf3-srv_10.42.42.10(pid=10273): Launched 20:10:39.571975 tst cs_paging_gprs_active.py:38: start network... 20:10:39.791383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:40.295037 run create_hlr_db(pid=10274): Launched 20:10:40.426338 bus /sierra_2: Setting Powered False 20:10:41.490042 run create_hlr_db(pid=10274): Terminated: ok {rc=0} 20:10:41.944822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10276): Launched 20:10:42.273900 run osmo-hlr_10.42.42.2(pid=10277): Launched 20:10:42.397794 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:42.953521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10279): Launched 20:10:43.276893 run osmo-stp_10.42.42.5(pid=10280): Launched 20:10:43.399643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:10:44.964783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10282): Launched 20:10:45.087634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:10:45.384754 run patchelf(pid=10283): Launched 20:10:45.565313 run osmo-stp_10.42.42.5(pid=10280): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10280)] 20:10:45.702501 run osmo-stp_10.42.42.5(pid=10280): stdout: | (launched: 2022-12-09_20:10:43.216616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:45.839977 run osmo-stp_10.42.42.5(pid=10280): stderr: | 20221209201043408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201043408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201043408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201043408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201043409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201043409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201043409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:45.987911 run osmo-stp_10.42.42.5(pid=10280): stdout: | (launched: 2022-12-09_20:10:43.216616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:46.116611 run osmo-stp_10.42.42.5(pid=10280): stderr: | 20221209201043408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201043408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201043408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201043408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201043409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201043409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201043409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:46.267621 run patchelf(pid=10283): Terminating (SIGINT) 20:10:46.442913 run patchelf(pid=10283): Terminated: ok {rc=0} 20:10:46.570131 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10280): Process ended prematurely: osmo-stp_10.42.42.5(pid=10280) [trial-2364↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10280)] [trial-2364↪gprs:sysmo↪cs_paging_gprs_active.py:38] 20:10:46.581259 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 20:10:46.611867 run osmo-hlr_10.42.42.2(pid=10277): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10277)] 20:10:46.662120 run osmo-hlr_10.42.42.2(pid=10277): stdout: | (launched: 2022-12-09_20:10:42.213496) 20:10:46.715271 run osmo-hlr_10.42.42.2(pid=10277): stderr: | 20221209201042414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201042414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201042414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201042414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201042414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201042414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201042426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201042435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201042435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201042435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:46.767207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Terminating (SIGTERM) 20:10:46.809773 run iperf3-srv_10.42.42.10(pid=10271): Terminating (SIGTERM) 20:10:46.855145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Terminating (SIGTERM) 20:10:46.897916 run iperf3-srv_10.42.42.10(pid=10273): Terminating (SIGTERM) 20:10:46.943228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10276): Terminating (SIGTERM) 20:10:46.987298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10279): Terminating (SIGTERM) 20:10:47.031187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10282): Terminating (SIGTERM) 20:10:47.075890 --- ParallelTerminationStrategy: PID 10270 died... 20:10:47.095686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10270): Terminated: ok {rc=0} 20:10:47.145137 --- ParallelTerminationStrategy: PID 10271 died... 20:10:47.164353 run iperf3-srv_10.42.42.10(pid=10271): Terminated {rc=256} 20:10:47.211452 --- ParallelTerminationStrategy: PID 10272 died... 20:10:47.230009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10272): Terminated: ok {rc=0} 20:10:47.275302 --- ParallelTerminationStrategy: PID 10273 died... 20:10:47.294105 run iperf3-srv_10.42.42.10(pid=10273): Terminated {rc=256} 20:10:47.339163 --- ParallelTerminationStrategy: PID 10276 died... 20:10:47.357949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10276): Terminated: ok {rc=0} 20:10:47.403067 --- ParallelTerminationStrategy: PID 10279 died... 20:10:47.421556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10279): Terminated: ok {rc=0} 20:10:47.467120 --- ParallelTerminationStrategy: PID 10282 died... 20:10:47.485958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10282): Terminated: ok {rc=0} 20:10:47.573780 bus /gobi_0: Setting Powered False 20:10:48.673069 bus /gobi_0: Setting Powered False 20:10:49.790155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo iperf3.py ---------------------------------------------- 20:10:50.936851 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:50.947824 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:10:50.982294 tst iperf3.py: using LAC 23429 20:10:51.108606 tst iperf3.py: using RAC 224 20:10:51.228928 tst iperf3.py: using CellId 23429 20:10:51.355565 tst iperf3.py: using BVCI 23430 20:10:51.466729 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.477419 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.487854 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.499277 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.510759 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.522103 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.533456 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.544514 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:10:51.555921 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:10:51.671598 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:10:51.890525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:10:52.214220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Launched 20:10:52.494825 run iperf3-srv_10.42.42.10(pid=10285): Launched 20:10:52.615479 tst iperf3.py:8: start network... 20:10:52.832349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:10:53.329616 run create_hlr_db(pid=10286): Launched 20:10:53.460726 bus /gobi_6: Setting Powered False 20:10:54.524675 run create_hlr_db(pid=10286): Terminated: ok {rc=0} 20:10:54.953415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10288): Launched 20:10:55.253111 run osmo-hlr_10.42.42.2(pid=10289): Launched 20:10:55.367793 run osmo-stp_10.42.42.5: Starting osmo-stp 20:10:55.885563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10291): Launched 20:10:56.183586 run osmo-stp_10.42.42.5(pid=10292): Launched 20:10:56.297135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:10:56.813284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10294): Launched 20:10:56.927820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:10:57.181686 run patchelf(pid=10295): Launched 20:10:57.348726 run osmo-stp_10.42.42.5(pid=10292): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10292)] 20:10:57.475606 run osmo-stp_10.42.42.5(pid=10292): stdout: | (launched: 2022-12-09_20:10:56.128569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:57.604024 run osmo-stp_10.42.42.5(pid=10292): stderr: | 20221209201056295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201056296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201056296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201056296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201056297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201056297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201056297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:57.732799 run osmo-stp_10.42.42.5(pid=10292): stdout: | (launched: 2022-12-09_20:10:56.128569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:10:57.855537 run osmo-stp_10.42.42.5(pid=10292): stderr: | 20221209201056295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201056296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201056296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201056296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201056297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201056297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201056297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:10:58.001472 run patchelf(pid=10295): Terminating (SIGINT) 20:10:58.169664 run patchelf(pid=10295): Terminated: ok {rc=0} 20:10:58.291227 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10292): Process ended prematurely: osmo-stp_10.42.42.5(pid=10292) [trial-2364↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10292)] [trial-2364↪gprs:sysmo↪iperf3.py:8] 20:10:58.300709 tst iperf3.py:8: Test FAILED (7.4 sec) 20:10:58.328285 run osmo-hlr_10.42.42.2(pid=10289): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10289)] 20:10:58.375874 run osmo-hlr_10.42.42.2(pid=10289): stdout: | (launched: 2022-12-09_20:10:55.197946) 20:10:58.424877 run osmo-hlr_10.42.42.2(pid=10289): stderr: | 20221209201055370 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201055370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201055371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201055371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201055371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201055371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201055382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201055391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201055391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201055391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:10:58.474347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Terminating (SIGTERM) 20:10:58.513424 run iperf3-srv_10.42.42.10(pid=10285): Terminating (SIGTERM) 20:10:58.552316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10288): Terminating (SIGTERM) 20:10:58.591197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10291): Terminating (SIGTERM) 20:10:58.630068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10294): Terminating (SIGTERM) 20:10:58.669278 --- ParallelTerminationStrategy: PID 10284 died... 20:10:58.687849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10284): Terminated: ok {rc=0} 20:10:58.731226 --- ParallelTerminationStrategy: PID 10285 died... 20:10:58.749405 run iperf3-srv_10.42.42.10(pid=10285): Terminated {rc=256} 20:10:58.792636 --- ParallelTerminationStrategy: PID 10288 died... 20:10:58.810802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10288): Terminated: ok {rc=0} 20:10:58.854010 --- ParallelTerminationStrategy: PID 10291 died... 20:10:58.872172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10291): Terminated: ok {rc=0} 20:10:58.915458 --- ParallelTerminationStrategy: PID 10294 died... 20:10:58.933585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10294): Terminated: ok {rc=0} 20:10:59.018386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo iperf3m4.py ---------------------------------------------- 20:11:00.164795 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.175869 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:11:00.212044 tst iperf3m4.py: using LAC 23430 20:11:00.331140 tst iperf3m4.py: using RAC 225 20:11:00.449520 tst iperf3m4.py: using CellId 23430 20:11:00.572402 tst iperf3m4.py: using BVCI 23431 20:11:00.683047 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.693514 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.703903 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.714669 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.725292 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.735813 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.746424 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.757044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:00.767969 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:00.903663 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:01.028326 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:01.176570 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:01.313377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:11:01.555763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:01.869628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Launched 20:11:02.154904 run iperf3-srv_10.42.42.10(pid=10297): Launched 20:11:02.280402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:11:02.485150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:02.787726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10298): Launched 20:11:03.048881 run iperf3-srv_10.42.42.10(pid=10299): Launched 20:11:03.161993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:11:03.362988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:03.665780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10300): Launched 20:11:03.927124 run iperf3-srv_10.42.42.10(pid=10301): Launched 20:11:04.039192 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:11:04.238928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:04.540102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10302): Launched 20:11:04.817085 run iperf3-srv_10.42.42.10(pid=10303): Launched 20:11:04.938788 tst iperf3m4.py:8: start network... 20:11:05.156006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:05.658398 run create_hlr_db(pid=10304): Launched 20:11:05.790197 bus /gobi_6: Setting Powered False 20:11:06.853890 run create_hlr_db(pid=10304): Terminated: ok {rc=0} 20:11:07.283154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10306): Launched 20:11:07.583312 run osmo-hlr_10.42.42.2(pid=10307): Launched 20:11:07.696884 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:08.211526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10309): Launched 20:11:08.511178 run osmo-stp_10.42.42.5(pid=10310): Launched 20:11:08.626699 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:09.148733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10312): Launched 20:11:09.265557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:09.523095 run patchelf(pid=10313): Launched 20:11:09.692184 run osmo-stp_10.42.42.5(pid=10310): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10310)] 20:11:09.822207 run osmo-stp_10.42.42.5(pid=10310): stdout: | (launched: 2022-12-09_20:11:08.455331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:09.953390 run osmo-stp_10.42.42.5(pid=10310): stderr: | 20221209201108621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201108622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201108622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201108622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201108623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201108623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201108623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:10.084374 run osmo-stp_10.42.42.5(pid=10310): stdout: | (launched: 2022-12-09_20:11:08.455331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:10.209671 run osmo-stp_10.42.42.5(pid=10310): stderr: | 20221209201108621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201108622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201108622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201108622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201108623 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201108623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201108623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:10.358214 run patchelf(pid=10313): Terminating (SIGINT) 20:11:10.529327 run patchelf(pid=10313): Terminated: ok {rc=0} 20:11:10.652854 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10310): Process ended prematurely: osmo-stp_10.42.42.5(pid=10310) [trial-2364↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10310)] [trial-2364↪gprs:sysmo↪iperf3m4.py:8] 20:11:10.662539 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:11:10.690362 run osmo-hlr_10.42.42.2(pid=10307): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10307)] 20:11:10.738116 run osmo-hlr_10.42.42.2(pid=10307): stdout: | (launched: 2022-12-09_20:11:07.528342) 20:11:10.787693 run osmo-hlr_10.42.42.2(pid=10307): stderr: | 20221209201107700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201107700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201107700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201107700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201107700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201107700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201107757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201107766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201107767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201107767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:10.837744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Terminating (SIGTERM) 20:11:10.877173 run iperf3-srv_10.42.42.10(pid=10297): Terminating (SIGTERM) 20:11:10.916385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10298): Terminating (SIGTERM) 20:11:10.955396 run iperf3-srv_10.42.42.10(pid=10299): Terminating (SIGTERM) 20:11:10.994801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10300): Terminating (SIGTERM) 20:11:11.033738 run iperf3-srv_10.42.42.10(pid=10301): Terminating (SIGTERM) 20:11:11.072820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10302): Terminating (SIGTERM) 20:11:11.112111 run iperf3-srv_10.42.42.10(pid=10303): Terminating (SIGTERM) 20:11:11.151235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10306): Terminating (SIGTERM) 20:11:11.190869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10309): Terminating (SIGTERM) 20:11:11.230173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10312): Terminating (SIGTERM) 20:11:11.269686 --- ParallelTerminationStrategy: PID 10296 died... 20:11:11.288549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Terminated: ok {rc=0} 20:11:11.332890 --- ParallelTerminationStrategy: PID 10297 died... 20:11:11.351385 run iperf3-srv_10.42.42.10(pid=10297): Terminated {rc=256} 20:11:11.395169 --- ParallelTerminationStrategy: PID 10298 died... 20:11:11.413604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10298): Terminated: ok {rc=0} 20:11:11.457427 --- ParallelTerminationStrategy: PID 10299 died... 20:11:11.476003 run iperf3-srv_10.42.42.10(pid=10299): Terminated {rc=256} 20:11:11.519619 --- ParallelTerminationStrategy: PID 10300 died... 20:11:11.538087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10300): Terminated: ok {rc=0} 20:11:11.582086 --- ParallelTerminationStrategy: PID 10301 died... 20:11:11.600445 run iperf3-srv_10.42.42.10(pid=10301): Terminated {rc=256} 20:11:11.643599 --- ParallelTerminationStrategy: PID 10302 died... 20:11:11.662387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10302): Terminated: ok {rc=0} 20:11:11.706080 --- ParallelTerminationStrategy: PID 10303 died... 20:11:11.724813 run iperf3-srv_10.42.42.10(pid=10303): Terminated {rc=256} 20:11:11.768569 --- ParallelTerminationStrategy: PID 10306 died... 20:11:11.787107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10306): Terminated: ok {rc=0} 20:11:11.831643 --- ParallelTerminationStrategy: PID 10309 died... 20:11:11.850045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10309): Terminated: ok {rc=0} 20:11:11.894290 --- ParallelTerminationStrategy: PID 10312 died... 20:11:11.912820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10312): Terminated: ok {rc=0} 20:11:11.996716 bus /gobi_4: Setting Powered False 20:11:13.092155 bus /gobi_4: Setting Powered False 20:11:14.207527 bus /gobi_1: Setting Powered False 20:11:15.307708 bus /gobi_1: Setting Powered False 20:11:16.436120 bus /gobi_0: Setting Powered False 20:11:17.557100 bus /gobi_0: Setting Powered False 20:11:18.673266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo ping.py ---------------------------------------------- 20:11:19.775806 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:19.787415 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:11:19.824829 tst ping.py: using LAC 23431 20:11:19.952667 tst ping.py: using RAC 226 20:11:20.078560 tst ping.py: using CellId 23431 20:11:20.206719 tst ping.py: using BVCI 23432 20:11:20.324894 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.335943 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.346807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.357699 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.368403 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.379110 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.390000 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:20.400659 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:20.516924 tst ping.py:19: start network... 20:11:20.717194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:21.184508 run create_hlr_db(pid=10314): Launched 20:11:21.298655 bus /gobi_6: Setting Powered False 20:11:22.358140 run create_hlr_db(pid=10314): Terminated: ok {rc=0} 20:11:22.775489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10316): Launched 20:11:23.074833 run osmo-hlr_10.42.42.2(pid=10317): Launched 20:11:23.189131 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:23.718162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10319): Launched 20:11:24.018099 run osmo-stp_10.42.42.5(pid=10320): Launched 20:11:24.131962 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:24.659506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10322): Launched 20:11:24.774550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:25.027711 run patchelf(pid=10323): Launched 20:11:25.193903 run osmo-stp_10.42.42.5(pid=10320): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10320)] 20:11:25.320472 run osmo-stp_10.42.42.5(pid=10320): stdout: | (launched: 2022-12-09_20:11:23.962436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:25.449537 run osmo-stp_10.42.42.5(pid=10320): stderr: | 20221209201124130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201124131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201124131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201124131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201124132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201124132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201124132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:25.578480 run osmo-stp_10.42.42.5(pid=10320): stdout: | (launched: 2022-12-09_20:11:23.962436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:25.701482 run osmo-stp_10.42.42.5(pid=10320): stderr: | 20221209201124130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201124131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201124131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201124131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201124132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201124132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201124132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:25.846678 run patchelf(pid=10323): Terminating (SIGINT) 20:11:26.015272 run patchelf(pid=10323): Terminated: ok {rc=0} 20:11:26.136300 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10320): Process ended prematurely: osmo-stp_10.42.42.5(pid=10320) [trial-2364↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10320)] [trial-2364↪gprs:sysmo↪ping.py:22] 20:11:26.145173 tst ping.py:22: Test FAILED (6.4 sec) 20:11:26.172228 run osmo-hlr_10.42.42.2(pid=10317): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10317)] 20:11:26.220087 run osmo-hlr_10.42.42.2(pid=10317): stdout: | (launched: 2022-12-09_20:11:23.019851) 20:11:26.269579 run osmo-hlr_10.42.42.2(pid=10317): stderr: | 20221209201123196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201123196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201123196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201123196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201123196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201123196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201123208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201123216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201123217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201123217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:26.319294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10316): Terminating (SIGTERM) 20:11:26.359232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10319): Terminating (SIGTERM) 20:11:26.399198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10322): Terminating (SIGTERM) 20:11:26.439369 --- ParallelTerminationStrategy: PID 10316 died... 20:11:26.458538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10316): Terminated: ok {rc=0} 20:11:26.503679 --- ParallelTerminationStrategy: PID 10319 died... 20:11:26.522531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10319): Terminated: ok {rc=0} 20:11:26.566660 --- ParallelTerminationStrategy: PID 10322 died... 20:11:26.585471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10322): Terminated: ok {rc=0} 20:11:26.671448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 20:11:27.760354 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:27.771640 tst gprs:sysmo: Using 1 x bts (candidates: 1) 20:11:27.812696 tst ping_idle_ping.py: using LAC 23432 20:11:27.941460 tst ping_idle_ping.py: using RAC 227 20:11:28.067572 tst ping_idle_ping.py: using CellId 23432 20:11:28.192571 tst ping_idle_ping.py: using BVCI 23433 20:11:28.309782 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.320733 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.331779 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.343334 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.354988 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.366243 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.377756 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 20:11:28.389159 tst gprs:sysmo: Using 1 x modem (candidates: 4) 20:11:28.514735 tst ping_idle_ping.py:24: start network... 20:11:28.716456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:29.183204 run create_hlr_db(pid=10324): Launched 20:11:29.297780 bus /gobi_6: Setting Powered False 20:11:30.357302 run create_hlr_db(pid=10324): Terminated: ok {rc=0} 20:11:30.797390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10326): Launched 20:11:31.136111 run osmo-hlr_10.42.42.2(pid=10327): Launched 20:11:31.384257 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:32.044427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10329): Launched 20:11:32.375004 run osmo-stp_10.42.42.5(pid=10330): Launched 20:11:32.499265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:33.054514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10332): Launched 20:11:33.179049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:33.451133 run patchelf(pid=10333): Launched 20:11:33.630685 run osmo-stp_10.42.42.5(pid=10330): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10330)] 20:11:33.766416 run osmo-stp_10.42.42.5(pid=10330): stdout: | (launched: 2022-12-09_20:11:32.316531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:33.904239 run osmo-stp_10.42.42.5(pid=10330): stderr: | 20221209201132507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201132507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201132508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201132508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201132509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201132509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201132509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:34.042736 run osmo-stp_10.42.42.5(pid=10330): stdout: | (launched: 2022-12-09_20:11:32.316531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:34.174657 run osmo-stp_10.42.42.5(pid=10330): stderr: | 20221209201132507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201132507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201132508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201132508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201132509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201132509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201132509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:34.330639 run patchelf(pid=10333): Terminating (SIGINT) 20:11:34.510174 run patchelf(pid=10333): Terminated: ok {rc=0} 20:11:34.639378 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10330): Process ended prematurely: osmo-stp_10.42.42.5(pid=10330) [trial-2364↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10330)] [trial-2364↪gprs:sysmo↪ping_idle_ping.py:27] 20:11:34.648762 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 20:11:34.676632 run osmo-hlr_10.42.42.2(pid=10327): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10327)] 20:11:34.726053 run osmo-hlr_10.42.42.2(pid=10327): stdout: | (launched: 2022-12-09_20:11:31.077838) 20:11:34.777372 run osmo-hlr_10.42.42.2(pid=10327): stderr: | 20221209201131378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201131378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201131378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201131378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201131378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201131378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201131398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201131406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201131406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201131406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:34.829437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10326): Terminating (SIGTERM) 20:11:34.870682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10329): Terminating (SIGTERM) 20:11:34.912009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10332): Terminating (SIGTERM) 20:11:34.953672 --- ParallelTerminationStrategy: PID 10326 died... 20:11:34.973522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10326): Terminated: ok {rc=0} 20:11:35.019557 --- ParallelTerminationStrategy: PID 10329 died... 20:11:35.038877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10329): Terminated: ok {rc=0} 20:11:35.084932 --- ParallelTerminationStrategy: PID 10332 died... 20:11:35.104448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10332): Terminated: ok {rc=0} 20:11:35.191328 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 20:11:36.481976 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:11:36.488062 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:11:36.509903 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:11:36.549607 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:11:36.638058 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:11:36.659440 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:11:36.699198 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:11:37.298659 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:11:37.352852 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.363561 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:37.399824 tst cs_paging_gprs_active.py: using LAC 23433 20:11:37.530236 tst cs_paging_gprs_active.py: using RAC 228 20:11:37.657079 tst cs_paging_gprs_active.py: using CellId 23433 20:11:37.784086 tst cs_paging_gprs_active.py: using BVCI 23434 20:11:37.905305 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.916677 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.927900 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.939084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.950142 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.961063 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.972166 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.983061 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:37.994209 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:38.115349 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:38.239414 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:11:38.463755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:38.793799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10337): Launched 20:11:39.080272 run iperf3-srv_10.42.42.10(pid=10338): Launched 20:11:39.203828 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:11:39.426365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:39.756144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10339): Launched 20:11:40.042619 run iperf3-srv_10.42.42.10(pid=10340): Launched 20:11:40.167660 tst cs_paging_gprs_active.py:38: start network... 20:11:40.389934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:40.900027 run create_hlr_db(pid=10341): Launched 20:11:41.033534 bus /gobi_6: Setting Powered False 20:11:42.098718 run create_hlr_db(pid=10341): Terminated: ok {rc=0} 20:11:42.535251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Launched 20:11:42.841089 run osmo-hlr_10.42.42.2(pid=10344): Launched 20:11:42.956919 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:43.483173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Launched 20:11:43.788218 run osmo-stp_10.42.42.5(pid=10347): Launched 20:11:43.904250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:44.430984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Launched 20:11:44.547513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:44.805648 run patchelf(pid=10350): Launched 20:11:44.975506 run osmo-stp_10.42.42.5(pid=10347): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] 20:11:45.105186 run osmo-stp_10.42.42.5(pid=10347): stdout: | (launched: 2022-12-09_20:11:43.732382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:45.235908 run osmo-stp_10.42.42.5(pid=10347): stderr: | 20221209201143899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201143900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201143900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201143900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201143901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201143901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201143901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:45.367531 run osmo-stp_10.42.42.5(pid=10347): stdout: | (launched: 2022-12-09_20:11:43.732382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:45.493182 run osmo-stp_10.42.42.5(pid=10347): stderr: | 20221209201143899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201143900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201143900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201143900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201143901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201143901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201143901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:45.642181 run patchelf(pid=10350): Terminating (SIGINT) 20:11:45.815011 run patchelf(pid=10350): Terminated: ok {rc=0} 20:11:45.974995 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10347): Process ended prematurely: osmo-stp_10.42.42.5(pid=10347) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] [trial-2364↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:11:45.986830 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:11:46.017504 run osmo-hlr_10.42.42.2(pid=10344): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10344)] 20:11:46.071791 run osmo-hlr_10.42.42.2(pid=10344): stdout: | (launched: 2022-12-09_20:11:42.785280) 20:11:46.127553 run osmo-hlr_10.42.42.2(pid=10344): stderr: | 20221209201142961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201142961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201142961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201142961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201142961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201142962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201142974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201142985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201142986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201142986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:46.182416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10337): Terminating (SIGTERM) 20:11:46.226899 run iperf3-srv_10.42.42.10(pid=10338): Terminating (SIGTERM) 20:11:46.272300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10339): Terminating (SIGTERM) 20:11:46.318033 run iperf3-srv_10.42.42.10(pid=10340): Terminating (SIGTERM) 20:11:46.363744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Terminating (SIGTERM) 20:11:46.408536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Terminating (SIGTERM) 20:11:46.455229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Terminating (SIGTERM) 20:11:46.502052 --- ParallelTerminationStrategy: PID 10337 died... 20:11:46.524306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10337): Terminated: ok {rc=0} 20:11:46.574959 --- ParallelTerminationStrategy: PID 10338 died... 20:11:46.595883 run iperf3-srv_10.42.42.10(pid=10338): Terminated {rc=256} 20:11:46.645270 --- ParallelTerminationStrategy: PID 10339 died... 20:11:46.666225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10339): Terminated: ok {rc=0} 20:11:46.716667 --- ParallelTerminationStrategy: PID 10340 died... 20:11:46.737739 run iperf3-srv_10.42.42.10(pid=10340): Terminated {rc=256} 20:11:46.785484 --- ParallelTerminationStrategy: PID 10343 died... 20:11:46.806078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10343): Terminated: ok {rc=0} 20:11:46.854097 --- ParallelTerminationStrategy: PID 10346 died... 20:11:46.874519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10346): Terminated: ok {rc=0} 20:11:46.923606 --- ParallelTerminationStrategy: PID 10349 died... 20:11:46.944259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10349): Terminated: ok {rc=0} 20:11:47.035315 bus /gobi_0: Setting Powered False 20:11:48.136701 bus /gobi_0: Setting Powered False 20:11:49.251814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:11:50.402068 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:50.414197 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:50.453275 tst iperf3.py: using LAC 23434 20:11:50.586197 tst iperf3.py: using RAC 229 20:11:50.714903 tst iperf3.py: using CellId 23434 20:11:50.843756 tst iperf3.py: using BVCI 23435 20:11:50.963102 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:50.974473 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:50.985833 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:50.997441 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:51.009011 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:51.020361 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:51.031942 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:51.043298 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:51.054679 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:11:51.177934 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:11:51.399652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:11:51.728124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10351): Launched 20:11:52.011904 run iperf3-srv_10.42.42.10(pid=10352): Launched 20:11:52.134383 tst iperf3.py:8: start network... 20:11:52.357099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:11:52.864704 run create_hlr_db(pid=10353): Launched 20:11:52.997826 bus /gobi_6: Setting Powered False 20:11:54.062523 run create_hlr_db(pid=10353): Terminated: ok {rc=0} 20:11:54.498177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10355): Launched 20:11:54.804122 run osmo-hlr_10.42.42.2(pid=10356): Launched 20:11:54.920187 run osmo-stp_10.42.42.5: Starting osmo-stp 20:11:55.460046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10358): Launched 20:11:55.765640 run osmo-stp_10.42.42.5(pid=10359): Launched 20:11:55.882856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:11:56.410447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10361): Launched 20:11:56.526905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:11:56.784284 run patchelf(pid=10362): Launched 20:11:56.953913 run osmo-stp_10.42.42.5(pid=10359): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10359)] 20:11:57.082858 run osmo-stp_10.42.42.5(pid=10359): stdout: | (launched: 2022-12-09_20:11:55.710155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:57.213302 run osmo-stp_10.42.42.5(pid=10359): stderr: | 20221209201155877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201155878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201155878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201155878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201155879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201155879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201155879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:57.344318 run osmo-stp_10.42.42.5(pid=10359): stdout: | (launched: 2022-12-09_20:11:55.710155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:11:57.469612 run osmo-stp_10.42.42.5(pid=10359): stderr: | 20221209201155877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201155878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201155878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201155878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201155879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201155879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201155879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:11:57.618239 run patchelf(pid=10362): Terminating (SIGINT) 20:11:57.788787 run patchelf(pid=10362): Terminated: ok {rc=0} 20:11:57.912581 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10359): Process ended prematurely: osmo-stp_10.42.42.5(pid=10359) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10359)] [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 20:11:57.922291 tst iperf3.py:8: Test FAILED (7.6 sec) 20:11:57.949602 run osmo-hlr_10.42.42.2(pid=10356): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10356)] 20:11:57.997235 run osmo-hlr_10.42.42.2(pid=10356): stdout: | (launched: 2022-12-09_20:11:54.748304) 20:11:58.046590 run osmo-hlr_10.42.42.2(pid=10356): stderr: | 20221209201154923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201154923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201154923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201154923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201154923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201154923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201154934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201154943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201154943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201154944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:11:58.096705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10351): Terminating (SIGTERM) 20:11:58.136370 run iperf3-srv_10.42.42.10(pid=10352): Terminating (SIGTERM) 20:11:58.175935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10355): Terminating (SIGTERM) 20:11:58.216029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10358): Terminating (SIGTERM) 20:11:58.255664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10361): Terminating (SIGTERM) 20:11:58.295491 --- ParallelTerminationStrategy: PID 10351 died... 20:11:58.314466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10351): Terminated: ok {rc=0} 20:11:58.358820 --- ParallelTerminationStrategy: PID 10352 died... 20:11:58.377263 run iperf3-srv_10.42.42.10(pid=10352): Terminated {rc=256} 20:11:58.421030 --- ParallelTerminationStrategy: PID 10355 died... 20:11:58.439621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10355): Terminated: ok {rc=0} 20:11:58.483988 --- ParallelTerminationStrategy: PID 10358 died... 20:11:58.502622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10358): Terminated: ok {rc=0} 20:11:58.546477 --- ParallelTerminationStrategy: PID 10361 died... 20:11:58.565001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10361): Terminated: ok {rc=0} 20:11:58.650969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:11:59.798367 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:11:59.809970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:11:59.848512 tst iperf3m4.py: using LAC 23435 20:11:59.971121 tst iperf3m4.py: using RAC 230 20:12:00.092638 tst iperf3m4.py: using CellId 23435 20:12:00.218250 tst iperf3m4.py: using BVCI 23436 20:12:00.331702 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.342454 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.353137 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.364191 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.374937 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.385731 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.396663 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.407340 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:00.418365 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:00.539534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:00.661872 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:00.784335 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:00.931988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:01.153314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:01.470739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10363): Launched 20:12:01.757403 run iperf3-srv_10.42.42.10(pid=10364): Launched 20:12:01.925370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:12:02.196131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:02.507501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10365): Launched 20:12:02.774511 run iperf3-srv_10.42.42.10(pid=10366): Launched 20:12:02.891009 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:12:03.095645 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:03.402722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10367): Launched 20:12:03.669173 run iperf3-srv_10.42.42.10(pid=10368): Launched 20:12:03.783695 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:12:03.988508 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:04.295606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Launched 20:12:04.561552 run iperf3-srv_10.42.42.10(pid=10370): Launched 20:12:04.676207 tst iperf3m4.py:8: start network... 20:12:04.881873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:05.354768 run create_hlr_db(pid=10371): Launched 20:12:05.470886 bus /gobi_6: Setting Powered False 20:12:06.531434 run create_hlr_db(pid=10371): Terminated: ok {rc=0} 20:12:06.978583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10373): Launched 20:12:07.307451 run osmo-hlr_10.42.42.2(pid=10374): Launched 20:12:07.434334 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:07.997694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10376): Launched 20:12:08.325457 run osmo-stp_10.42.42.5(pid=10377): Launched 20:12:08.450305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:09.013764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10379): Launched 20:12:09.138450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:09.415148 run patchelf(pid=10380): Launched 20:12:09.598835 run osmo-stp_10.42.42.5(pid=10377): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10377)] 20:12:09.737395 run osmo-stp_10.42.42.5(pid=10377): stdout: | (launched: 2022-12-09_20:12:08.265233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:09.877038 run osmo-stp_10.42.42.5(pid=10377): stderr: | 20221209201208453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201208453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201208454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201208454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201208455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201208455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201208455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:10.016473 run osmo-stp_10.42.42.5(pid=10377): stdout: | (launched: 2022-12-09_20:12:08.265233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:10.150508 run osmo-stp_10.42.42.5(pid=10377): stderr: | 20221209201208453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201208453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201208454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201208454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201208455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201208455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201208455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:10.309831 run patchelf(pid=10380): Terminating (SIGINT) 20:12:10.493672 run patchelf(pid=10380): Terminated: ok {rc=0} 20:12:10.626363 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10377): Process ended prematurely: osmo-stp_10.42.42.5(pid=10377) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10377)] [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 20:12:10.636785 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:12:10.665743 run osmo-hlr_10.42.42.2(pid=10374): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10374)] 20:12:10.715739 run osmo-hlr_10.42.42.2(pid=10374): stdout: | (launched: 2022-12-09_20:12:07.247533) 20:12:10.767599 run osmo-hlr_10.42.42.2(pid=10374): stderr: | 20221209201207441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201207441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201207441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201207441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201207441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201207441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201207454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201207463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201207463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201207463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:10.819752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10363): Terminating (SIGTERM) 20:12:10.861469 run iperf3-srv_10.42.42.10(pid=10364): Terminating (SIGTERM) 20:12:10.903101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10365): Terminating (SIGTERM) 20:12:10.944712 run iperf3-srv_10.42.42.10(pid=10366): Terminating (SIGTERM) 20:12:10.986231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10367): Terminating (SIGTERM) 20:12:11.027869 run iperf3-srv_10.42.42.10(pid=10368): Terminating (SIGTERM) 20:12:11.069402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Terminating (SIGTERM) 20:12:11.111085 run iperf3-srv_10.42.42.10(pid=10370): Terminating (SIGTERM) 20:12:11.152639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10373): Terminating (SIGTERM) 20:12:11.194311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10376): Terminating (SIGTERM) 20:12:11.236070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10379): Terminating (SIGTERM) 20:12:11.278164 --- ParallelTerminationStrategy: PID 10363 died... 20:12:11.298178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10363): Terminated: ok {rc=0} 20:12:11.344642 --- ParallelTerminationStrategy: PID 10364 died... 20:12:11.364171 run iperf3-srv_10.42.42.10(pid=10364): Terminated {rc=256} 20:12:11.410449 --- ParallelTerminationStrategy: PID 10365 died... 20:12:11.429903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10365): Terminated: ok {rc=0} 20:12:11.476085 --- ParallelTerminationStrategy: PID 10366 died... 20:12:11.495690 run iperf3-srv_10.42.42.10(pid=10366): Terminated {rc=256} 20:12:11.541729 --- ParallelTerminationStrategy: PID 10367 died... 20:12:11.561273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10367): Terminated: ok {rc=0} 20:12:11.607433 --- ParallelTerminationStrategy: PID 10368 died... 20:12:11.626856 run iperf3-srv_10.42.42.10(pid=10368): Terminated {rc=256} 20:12:11.672725 --- ParallelTerminationStrategy: PID 10369 died... 20:12:11.692424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10369): Terminated: ok {rc=0} 20:12:11.738634 --- ParallelTerminationStrategy: PID 10370 died... 20:12:11.758212 run iperf3-srv_10.42.42.10(pid=10370): Terminated {rc=256} 20:12:11.804104 --- ParallelTerminationStrategy: PID 10373 died... 20:12:11.823720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10373): Terminated: ok {rc=0} 20:12:11.869920 --- ParallelTerminationStrategy: PID 10376 died... 20:12:11.889543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10376): Terminated: ok {rc=0} 20:12:11.936041 --- ParallelTerminationStrategy: PID 10379 died... 20:12:11.955828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10379): Terminated: ok {rc=0} 20:12:12.044216 bus /gobi_4: Setting Powered False 20:12:13.144543 bus /gobi_4: Setting Powered False 20:12:14.264768 bus /gobi_1: Setting Powered False 20:12:15.364546 bus /gobi_1: Setting Powered False 20:12:16.480635 bus /gobi_0: Setting Powered False 20:12:17.581390 bus /gobi_0: Setting Powered False 20:12:18.698305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 20:12:19.802415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:19.814595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:12:19.853849 tst ping.py: using LAC 23436 20:12:19.981399 tst ping.py: using RAC 231 20:12:20.107788 tst ping.py: using CellId 23436 20:12:20.234371 tst ping.py: using BVCI 23437 20:12:20.353586 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.365050 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.376171 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.387568 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.398767 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.409958 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.421313 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:20.432564 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:20.551665 tst ping.py:19: start network... 20:12:20.754526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:21.221332 run create_hlr_db(pid=10381): Launched 20:12:21.336803 bus /gobi_6: Setting Powered False 20:12:22.397389 run create_hlr_db(pid=10381): Terminated: ok {rc=0} 20:12:22.838786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10383): Launched 20:12:23.163353 run osmo-hlr_10.42.42.2(pid=10384): Launched 20:12:23.285986 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:23.842737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10386): Launched 20:12:24.163905 run osmo-stp_10.42.42.5(pid=10387): Launched 20:12:24.286696 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:24.847051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10389): Launched 20:12:24.971426 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:25.243872 run patchelf(pid=10390): Launched 20:12:25.422645 run osmo-stp_10.42.42.5(pid=10387): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10387)] 20:12:25.559251 run osmo-stp_10.42.42.5(pid=10387): stdout: | (launched: 2022-12-09_20:12:24.105246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:25.696634 run osmo-stp_10.42.42.5(pid=10387): stderr: | 20221209201224295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201224296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201224296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201224296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201224297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201224297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201224297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:25.834416 run osmo-stp_10.42.42.5(pid=10387): stdout: | (launched: 2022-12-09_20:12:24.105246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:25.965796 run osmo-stp_10.42.42.5(pid=10387): stderr: | 20221209201224295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201224296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201224296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201224296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201224297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201224297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201224297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:26.121924 run patchelf(pid=10390): Terminating (SIGINT) 20:12:26.297887 run patchelf(pid=10390): Terminated: ok {rc=0} 20:12:26.420505 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10387): Process ended prematurely: osmo-stp_10.42.42.5(pid=10387) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10387)] [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 20:12:26.429731 tst ping.py:22: Test FAILED (6.6 sec) 20:12:26.458522 run osmo-hlr_10.42.42.2(pid=10384): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10384)] 20:12:26.507406 run osmo-hlr_10.42.42.2(pid=10384): stdout: | (launched: 2022-12-09_20:12:23.104523) 20:12:26.558141 run osmo-hlr_10.42.42.2(pid=10384): stderr: | 20221209201223302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201223302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201223302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201223302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201223302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201223302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201223315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201223323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201223323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201223323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:26.608779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10383): Terminating (SIGTERM) 20:12:26.649557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10386): Terminating (SIGTERM) 20:12:26.690307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10389): Terminating (SIGTERM) 20:12:26.730977 --- ParallelTerminationStrategy: PID 10383 died... 20:12:26.750168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10383): Terminated: ok {rc=0} 20:12:26.795832 --- ParallelTerminationStrategy: PID 10386 died... 20:12:26.814614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10386): Terminated: ok {rc=0} 20:12:26.860112 --- ParallelTerminationStrategy: PID 10389 died... 20:12:26.879001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10389): Terminated: ok {rc=0} 20:12:26.967223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:12:28.055411 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.067423 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:12:28.105957 tst ping_idle_ping.py: using LAC 23437 20:12:28.227175 tst ping_idle_ping.py: using RAC 232 20:12:28.348060 tst ping_idle_ping.py: using CellId 23437 20:12:28.467277 tst ping_idle_ping.py: using BVCI 23438 20:12:28.579007 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.589810 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.600458 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.611955 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.623106 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.634407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.645829 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:12:28.657083 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:12:28.780400 tst ping_idle_ping.py:24: start network... 20:12:28.983263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:29.449330 run create_hlr_db(pid=10391): Launched 20:12:29.564602 bus /gobi_6: Setting Powered False 20:12:30.625160 run create_hlr_db(pid=10391): Terminated: ok {rc=0} 20:12:31.073339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10393): Launched 20:12:31.412213 run osmo-hlr_10.42.42.2(pid=10394): Launched 20:12:31.729654 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:32.423172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10396): Launched 20:12:32.725559 run osmo-stp_10.42.42.5(pid=10397): Launched 20:12:32.839959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:33.359050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10399): Launched 20:12:33.473564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:33.727251 run patchelf(pid=10400): Launched 20:12:33.894006 run osmo-stp_10.42.42.5(pid=10397): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10397)] 20:12:34.020894 run osmo-stp_10.42.42.5(pid=10397): stdout: | (launched: 2022-12-09_20:12:32.670809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:34.149846 run osmo-stp_10.42.42.5(pid=10397): stderr: | 20221209201232839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201232839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201232839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201232840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201232840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201232840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201232840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:34.278756 run osmo-stp_10.42.42.5(pid=10397): stdout: | (launched: 2022-12-09_20:12:32.670809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:34.401599 run osmo-stp_10.42.42.5(pid=10397): stderr: | 20221209201232839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201232839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201232839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201232840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201232840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201232840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201232840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:34.547750 run patchelf(pid=10400): Terminating (SIGINT) 20:12:34.715463 run patchelf(pid=10400): Terminated: ok {rc=0} 20:12:34.836628 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10397): Process ended prematurely: osmo-stp_10.42.42.5(pid=10397) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10397)] [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 20:12:34.845749 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:12:34.872719 run osmo-hlr_10.42.42.2(pid=10394): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10394)] 20:12:34.920285 run osmo-hlr_10.42.42.2(pid=10394): stdout: | (launched: 2022-12-09_20:12:31.352705) 20:12:34.969629 run osmo-hlr_10.42.42.2(pid=10394): stderr: | 20221209201231579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201231579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201231579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201231579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201231579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201231579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201231595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201231619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201231621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201231621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:35.019138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10393): Terminating (SIGTERM) 20:12:35.058562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10396): Terminating (SIGTERM) 20:12:35.098186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10399): Terminating (SIGTERM) 20:12:35.138338 --- ParallelTerminationStrategy: PID 10393 died... 20:12:35.157355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10393): Terminated: ok {rc=0} 20:12:35.201773 --- ParallelTerminationStrategy: PID 10396 died... 20:12:35.220385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10396): Terminated: ok {rc=0} 20:12:35.264692 --- ParallelTerminationStrategy: PID 10399 died... 20:12:35.283301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10399): Terminated: ok {rc=0} 20:12:35.369588 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:12:36.658453 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:12:36.664716 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:12:36.686601 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:12:36.724903 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:12:36.808996 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:12:36.829869 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:12:36.868361 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:12:37.463003 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:12:37.512552 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:37.523498 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:12:37.577752 tst cs_paging_gprs_active.py: using LAC 23438 20:12:37.697739 tst cs_paging_gprs_active.py: using RAC 233 20:12:37.817745 tst cs_paging_gprs_active.py: using CellId 23438 20:12:37.937862 tst cs_paging_gprs_active.py: using BVCI 23439 20:12:38.050811 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.061701 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.072392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.083314 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.094149 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.104873 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.115723 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.126720 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:38.137854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:38.257706 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:38.382146 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:12:38.605455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:38.933747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10407): Launched 20:12:39.219083 run iperf3-srv_10.42.42.10(pid=10408): Launched 20:12:39.342937 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:12:39.563434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:39.891088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Launched 20:12:40.176077 run iperf3-srv_10.42.42.10(pid=10410): Launched 20:12:40.298497 tst cs_paging_gprs_active.py:38: start network... 20:12:40.520764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:41.028618 run create_hlr_db(pid=10411): Launched 20:12:41.161994 bus /gobi_6: Setting Powered False 20:12:42.226629 run create_hlr_db(pid=10411): Terminated: ok {rc=0} 20:12:42.663863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Launched 20:12:42.971251 run osmo-hlr_10.42.42.2(pid=10414): Launched 20:12:43.090118 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:43.631625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Launched 20:12:43.937169 run osmo-stp_10.42.42.5(pid=10417): Launched 20:12:44.053528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:44.582426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Launched 20:12:44.700858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:44.959676 run patchelf(pid=10420): Launched 20:12:45.129573 run osmo-stp_10.42.42.5(pid=10417): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] 20:12:45.259572 run osmo-stp_10.42.42.5(pid=10417): stdout: | (launched: 2022-12-09_20:12:43.881202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:45.390460 run osmo-stp_10.42.42.5(pid=10417): stderr: | 20221209201244048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201244048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201244048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201244049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201244049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201244049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201244049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:45.521668 run osmo-stp_10.42.42.5(pid=10417): stdout: | (launched: 2022-12-09_20:12:43.881202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:45.647000 run osmo-stp_10.42.42.5(pid=10417): stderr: | 20221209201244048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201244048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201244048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201244049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201244049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201244049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201244049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:45.795948 run patchelf(pid=10420): Terminating (SIGINT) 20:12:46.000830 run patchelf(pid=10420): Terminated: ok {rc=0} 20:12:46.138718 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10417): Process ended prematurely: osmo-stp_10.42.42.5(pid=10417) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:12:46.150127 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:12:46.181369 run osmo-hlr_10.42.42.2(pid=10414): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10414)] 20:12:46.232858 run osmo-hlr_10.42.42.2(pid=10414): stdout: | (launched: 2022-12-09_20:12:42.915553) 20:12:46.285652 run osmo-hlr_10.42.42.2(pid=10414): stderr: | 20221209201243087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201243087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201243087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201243087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201243087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201243088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201243099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201243107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201243108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201243108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:46.340123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10407): Terminating (SIGTERM) 20:12:46.383902 run iperf3-srv_10.42.42.10(pid=10408): Terminating (SIGTERM) 20:12:46.429999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Terminating (SIGTERM) 20:12:46.473778 run iperf3-srv_10.42.42.10(pid=10410): Terminating (SIGTERM) 20:12:46.517523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Terminating (SIGTERM) 20:12:46.561050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Terminating (SIGTERM) 20:12:46.606277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Terminating (SIGTERM) 20:12:46.650183 --- ParallelTerminationStrategy: PID 10407 died... 20:12:46.672511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10407): Terminated: ok {rc=0} 20:12:46.722346 --- ParallelTerminationStrategy: PID 10408 died... 20:12:46.742281 run iperf3-srv_10.42.42.10(pid=10408): Terminated {rc=256} 20:12:46.789728 --- ParallelTerminationStrategy: PID 10409 died... 20:12:46.809793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10409): Terminated: ok {rc=0} 20:12:46.856288 --- ParallelTerminationStrategy: PID 10410 died... 20:12:46.876235 run iperf3-srv_10.42.42.10(pid=10410): Terminated {rc=256} 20:12:46.924233 --- ParallelTerminationStrategy: PID 10413 died... 20:12:46.944166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10413): Terminated: ok {rc=0} 20:12:46.991942 --- ParallelTerminationStrategy: PID 10416 died... 20:12:47.012277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10416): Terminated: ok {rc=0} 20:12:47.059341 --- ParallelTerminationStrategy: PID 10419 died... 20:12:47.080831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10419): Terminated: ok {rc=0} 20:12:47.171729 bus /gobi_0: Setting Powered False 20:12:48.269554 bus /gobi_0: Setting Powered False 20:12:49.386831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:12:50.536698 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:50.548716 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:12:50.608064 tst iperf3.py: using LAC 23439 20:12:50.729466 tst iperf3.py: using RAC 234 20:12:50.855814 tst iperf3.py: using CellId 23439 20:12:50.974373 tst iperf3.py: using BVCI 23440 20:12:51.084924 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.095941 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.106756 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.117669 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.128333 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.139055 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.150125 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.160761 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:51.171746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:12:51.291466 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:12:51.515062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:12:51.844626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10421): Launched 20:12:52.130186 run iperf3-srv_10.42.42.10(pid=10422): Launched 20:12:52.254260 tst iperf3.py:8: start network... 20:12:52.476128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:12:52.984322 run create_hlr_db(pid=10423): Launched 20:12:53.118071 bus /gobi_6: Setting Powered False 20:12:54.183117 run create_hlr_db(pid=10423): Terminated: ok {rc=0} 20:12:54.618831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10425): Launched 20:12:54.924819 run osmo-hlr_10.42.42.2(pid=10426): Launched 20:12:55.041903 run osmo-stp_10.42.42.5: Starting osmo-stp 20:12:55.585169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10428): Launched 20:12:55.891366 run osmo-stp_10.42.42.5(pid=10429): Launched 20:12:56.008677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:12:56.537279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10431): Launched 20:12:56.653968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:12:56.912929 run patchelf(pid=10432): Launched 20:12:57.082848 run osmo-stp_10.42.42.5(pid=10429): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10429)] 20:12:57.211901 run osmo-stp_10.42.42.5(pid=10429): stdout: | (launched: 2022-12-09_20:12:55.834966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:57.342752 run osmo-stp_10.42.42.5(pid=10429): stderr: | 20221209201256002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201256002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201256003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201256003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201256004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201256004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201256004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:57.473346 run osmo-stp_10.42.42.5(pid=10429): stdout: | (launched: 2022-12-09_20:12:55.834966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:12:57.598712 run osmo-stp_10.42.42.5(pid=10429): stderr: | 20221209201256002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201256002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201256003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201256003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201256004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201256004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201256004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:12:57.746958 run patchelf(pid=10432): Terminating (SIGINT) 20:12:57.918207 run patchelf(pid=10432): Terminated: ok {rc=0} 20:12:58.042006 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10429): Process ended prematurely: osmo-stp_10.42.42.5(pid=10429) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10429)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 20:12:58.051727 tst iperf3.py:8: Test FAILED (7.6 sec) 20:12:58.079615 run osmo-hlr_10.42.42.2(pid=10426): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10426)] 20:12:58.127495 run osmo-hlr_10.42.42.2(pid=10426): stdout: | (launched: 2022-12-09_20:12:54.869099) 20:12:58.177147 run osmo-hlr_10.42.42.2(pid=10426): stderr: | 20221209201255044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201255044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201255044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201255044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201255044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201255044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201255059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201255068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201255068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201255068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:12:58.227240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10421): Terminating (SIGTERM) 20:12:58.267202 run iperf3-srv_10.42.42.10(pid=10422): Terminating (SIGTERM) 20:12:58.307003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10425): Terminating (SIGTERM) 20:12:58.347048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10428): Terminating (SIGTERM) 20:12:58.386977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10431): Terminating (SIGTERM) 20:12:58.427046 --- ParallelTerminationStrategy: PID 10421 died... 20:12:58.446035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10421): Terminated: ok {rc=0} 20:12:58.490148 --- ParallelTerminationStrategy: PID 10422 died... 20:12:58.509055 run iperf3-srv_10.42.42.10(pid=10422): Terminated {rc=256} 20:12:58.553401 --- ParallelTerminationStrategy: PID 10425 died... 20:12:58.572118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10425): Terminated: ok {rc=0} 20:12:58.616131 --- ParallelTerminationStrategy: PID 10428 died... 20:12:58.634791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10428): Terminated: ok {rc=0} 20:12:58.679213 --- ParallelTerminationStrategy: PID 10431 died... 20:12:58.698104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10431): Terminated: ok {rc=0} 20:12:58.784600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:12:59.932236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:12:59.943871 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:13:00.000192 tst iperf3m4.py: using LAC 23440 20:13:00.120603 tst iperf3m4.py: using RAC 235 20:13:00.241111 tst iperf3m4.py: using CellId 23440 20:13:00.370280 tst iperf3m4.py: using BVCI 23441 20:13:00.491553 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.503134 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.514610 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.526130 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.537511 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.548635 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.560391 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.571578 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:00.583287 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:00.706486 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:00.828867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:00.965503 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:01.087704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:01.352164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:01.690592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10433): Launched 20:13:01.984407 run iperf3-srv_10.42.42.10(pid=10434): Launched 20:13:02.161404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:13:02.370674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:02.679558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10435): Launched 20:13:02.946532 run iperf3-srv_10.42.42.10(pid=10436): Launched 20:13:03.063474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:13:03.268209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:03.574780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10437): Launched 20:13:03.840315 run iperf3-srv_10.42.42.10(pid=10438): Launched 20:13:03.955113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:13:04.160235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:04.467164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Launched 20:13:04.733752 run iperf3-srv_10.42.42.10(pid=10440): Launched 20:13:04.850673 tst iperf3m4.py:8: start network... 20:13:05.056573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:05.534020 run create_hlr_db(pid=10441): Launched 20:13:05.652188 bus /gobi_6: Setting Powered False 20:13:06.713647 run create_hlr_db(pid=10441): Terminated: ok {rc=0} 20:13:07.161739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10443): Launched 20:13:07.490999 run osmo-hlr_10.42.42.2(pid=10444): Launched 20:13:07.618043 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:08.183469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10446): Launched 20:13:08.509567 run osmo-stp_10.42.42.5(pid=10447): Launched 20:13:08.634394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:09.197535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10449): Launched 20:13:09.322819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:09.599634 run patchelf(pid=10450): Launched 20:13:09.782898 run osmo-stp_10.42.42.5(pid=10447): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10447)] 20:13:09.921184 run osmo-stp_10.42.42.5(pid=10447): stdout: | (launched: 2022-12-09_20:13:08.449745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:10.061081 run osmo-stp_10.42.42.5(pid=10447): stderr: | 20221209201308638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201308638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201308638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201308639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201308639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201308639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201308639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:10.200404 run osmo-stp_10.42.42.5(pid=10447): stdout: | (launched: 2022-12-09_20:13:08.449745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:10.334441 run osmo-stp_10.42.42.5(pid=10447): stderr: | 20221209201308638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201308638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201308638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201308639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201308639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201308639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201308639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:10.493103 run patchelf(pid=10450): Terminating (SIGINT) 20:13:10.675491 run patchelf(pid=10450): Terminated: ok {rc=0} 20:13:10.808013 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10447): Process ended prematurely: osmo-stp_10.42.42.5(pid=10447) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10447)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:13:10.818284 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:13:10.846771 run osmo-hlr_10.42.42.2(pid=10444): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10444)] 20:13:10.896291 run osmo-hlr_10.42.42.2(pid=10444): stdout: | (launched: 2022-12-09_20:13:07.431369) 20:13:10.947164 run osmo-hlr_10.42.42.2(pid=10444): stderr: | 20221209201307625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201307625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201307625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201307626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201307626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201307626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201307638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201307647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201307647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201307647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:10.998417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10433): Terminating (SIGTERM) 20:13:11.039970 run iperf3-srv_10.42.42.10(pid=10434): Terminating (SIGTERM) 20:13:11.081750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10435): Terminating (SIGTERM) 20:13:11.123624 run iperf3-srv_10.42.42.10(pid=10436): Terminating (SIGTERM) 20:13:11.165517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10437): Terminating (SIGTERM) 20:13:11.207075 run iperf3-srv_10.42.42.10(pid=10438): Terminating (SIGTERM) 20:13:11.248624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Terminating (SIGTERM) 20:13:11.290512 run iperf3-srv_10.42.42.10(pid=10440): Terminating (SIGTERM) 20:13:11.332021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10443): Terminating (SIGTERM) 20:13:11.373795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10446): Terminating (SIGTERM) 20:13:11.415464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10449): Terminating (SIGTERM) 20:13:11.457524 --- ParallelTerminationStrategy: PID 10433 died... 20:13:11.477856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10433): Terminated: ok {rc=0} 20:13:11.524483 --- ParallelTerminationStrategy: PID 10434 died... 20:13:11.543916 run iperf3-srv_10.42.42.10(pid=10434): Terminated {rc=256} 20:13:11.589843 --- ParallelTerminationStrategy: PID 10435 died... 20:13:11.609340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10435): Terminated: ok {rc=0} 20:13:11.655012 --- ParallelTerminationStrategy: PID 10436 died... 20:13:11.674434 run iperf3-srv_10.42.42.10(pid=10436): Terminated {rc=256} 20:13:11.720238 --- ParallelTerminationStrategy: PID 10437 died... 20:13:11.739890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10437): Terminated: ok {rc=0} 20:13:11.786455 --- ParallelTerminationStrategy: PID 10438 died... 20:13:11.806127 run iperf3-srv_10.42.42.10(pid=10438): Terminated {rc=256} 20:13:11.851905 --- ParallelTerminationStrategy: PID 10439 died... 20:13:11.871589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10439): Terminated: ok {rc=0} 20:13:11.917328 --- ParallelTerminationStrategy: PID 10440 died... 20:13:11.936857 run iperf3-srv_10.42.42.10(pid=10440): Terminated {rc=256} 20:13:11.982905 --- ParallelTerminationStrategy: PID 10443 died... 20:13:12.002630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10443): Terminated: ok {rc=0} 20:13:12.049031 --- ParallelTerminationStrategy: PID 10446 died... 20:13:12.068679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10446): Terminated: ok {rc=0} 20:13:12.115160 --- ParallelTerminationStrategy: PID 10449 died... 20:13:12.134824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10449): Terminated: ok {rc=0} 20:13:12.222645 bus /gobi_4: Setting Powered False 20:13:13.323348 bus /gobi_4: Setting Powered False 20:13:14.439752 bus /gobi_1: Setting Powered False 20:13:15.538849 bus /gobi_1: Setting Powered False 20:13:16.653091 bus /gobi_0: Setting Powered False 20:13:17.753806 bus /gobi_0: Setting Powered False 20:13:18.869408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:13:19.972173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:19.984233 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:13:20.042253 tst ping.py: using LAC 23441 20:13:20.169227 tst ping.py: using RAC 236 20:13:20.297443 tst ping.py: using CellId 23441 20:13:20.425496 tst ping.py: using BVCI 23442 20:13:20.543076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.554476 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.565657 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.576701 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.588070 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.599082 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.610367 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:20.621417 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:20.737581 tst ping.py:19: start network... 20:13:20.940630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:21.407943 run create_hlr_db(pid=10451): Launched 20:13:21.523813 bus /gobi_6: Setting Powered False 20:13:22.584883 run create_hlr_db(pid=10451): Terminated: ok {rc=0} 20:13:23.029478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Launched 20:13:23.353461 run osmo-hlr_10.42.42.2(pid=10454): Launched 20:13:23.478054 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:24.044172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Launched 20:13:24.365724 run osmo-stp_10.42.42.5(pid=10457): Launched 20:13:24.489293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:25.045079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10459): Launched 20:13:25.167216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:25.438958 run patchelf(pid=10460): Launched 20:13:25.617741 run osmo-stp_10.42.42.5(pid=10457): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] 20:13:25.753892 run osmo-stp_10.42.42.5(pid=10457): stdout: | (launched: 2022-12-09_20:13:24.306590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:25.891302 run osmo-stp_10.42.42.5(pid=10457): stderr: | 20221209201324499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201324500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201324500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201324500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201324501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201324501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201324501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:26.028630 run osmo-stp_10.42.42.5(pid=10457): stdout: | (launched: 2022-12-09_20:13:24.306590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:26.159982 run osmo-stp_10.42.42.5(pid=10457): stderr: | 20221209201324499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201324500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201324500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201324500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201324501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201324501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201324501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:26.315680 run patchelf(pid=10460): Terminating (SIGINT) 20:13:26.495286 run patchelf(pid=10460): Terminated: ok {rc=0} 20:13:26.624472 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10457): Process ended prematurely: osmo-stp_10.42.42.5(pid=10457) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 20:13:26.634184 tst ping.py:22: Test FAILED (6.7 sec) 20:13:26.662200 run osmo-hlr_10.42.42.2(pid=10454): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10454)] 20:13:26.712476 run osmo-hlr_10.42.42.2(pid=10454): stdout: | (launched: 2022-12-09_20:13:23.294373) 20:13:26.764211 run osmo-hlr_10.42.42.2(pid=10454): stderr: | 20221209201323491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201323491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201323491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201323491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201323491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201323491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201323504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201323514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201323514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201323514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:26.816350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Terminating (SIGTERM) 20:13:26.858262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Terminating (SIGTERM) 20:13:26.900424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10459): Terminating (SIGTERM) 20:13:26.943025 --- ParallelTerminationStrategy: PID 10453 died... 20:13:26.962975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10453): Terminated: ok {rc=0} 20:13:27.009813 --- ParallelTerminationStrategy: PID 10456 died... 20:13:27.029496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10456): Terminated: ok {rc=0} 20:13:27.075993 --- ParallelTerminationStrategy: PID 10459 died... 20:13:27.095711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10459): Terminated: ok {rc=0} 20:13:27.183606 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:13:28.271169 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.283090 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:13:28.347741 tst ping_idle_ping.py: using LAC 23442 20:13:28.473648 tst ping_idle_ping.py: using RAC 237 20:13:28.592881 tst ping_idle_ping.py: using CellId 23442 20:13:28.710743 tst ping_idle_ping.py: using BVCI 23443 20:13:28.822371 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.833406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.844179 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.855451 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.866499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.877575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.888625 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:13:28.899748 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:13:29.018864 tst ping_idle_ping.py:24: start network... 20:13:29.237587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:29.711758 run create_hlr_db(pid=10461): Launched 20:13:29.827397 bus /gobi_6: Setting Powered False 20:13:30.909894 run create_hlr_db(pid=10461): Terminated: ok {rc=0} 20:13:31.357709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10463): Launched 20:13:31.676551 run osmo-hlr_10.42.42.2(pid=10464): Launched 20:13:31.947401 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:32.572597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10466): Launched 20:13:32.874573 run osmo-stp_10.42.42.5(pid=10467): Launched 20:13:32.992101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:33.513654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10469): Launched 20:13:33.628809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:33.882857 run patchelf(pid=10470): Launched 20:13:34.051570 run osmo-stp_10.42.42.5(pid=10467): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10467)] 20:13:34.179013 run osmo-stp_10.42.42.5(pid=10467): stdout: | (launched: 2022-12-09_20:13:32.819280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:34.308202 run osmo-stp_10.42.42.5(pid=10467): stderr: | 20221209201332990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201332990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201332990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201332991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201332991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201332991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201332991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:34.437999 run osmo-stp_10.42.42.5(pid=10467): stdout: | (launched: 2022-12-09_20:13:32.819280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:34.561918 run osmo-stp_10.42.42.5(pid=10467): stderr: | 20221209201332990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201332990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201332990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201332991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201332991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201332991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201332991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:34.708121 run patchelf(pid=10470): Terminating (SIGINT) 20:13:34.877475 run patchelf(pid=10470): Terminated: ok {rc=0} 20:13:34.999785 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10467): Process ended prematurely: osmo-stp_10.42.42.5(pid=10467) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10467)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:13:35.008736 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:13:35.036095 run osmo-hlr_10.42.42.2(pid=10464): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10464)] 20:13:35.084080 run osmo-hlr_10.42.42.2(pid=10464): stdout: | (launched: 2022-12-09_20:13:31.614044) 20:13:35.133580 run osmo-hlr_10.42.42.2(pid=10464): stderr: | 20221209201331845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201331845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201331845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201331845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201331846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201331846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201331870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201331882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201331882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201331882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:35.183276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10463): Terminating (SIGTERM) 20:13:35.223082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10466): Terminating (SIGTERM) 20:13:35.262887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10469): Terminating (SIGTERM) 20:13:35.303026 --- ParallelTerminationStrategy: PID 10463 died... 20:13:35.322086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10463): Terminated: ok {rc=0} 20:13:35.366494 --- ParallelTerminationStrategy: PID 10466 died... 20:13:35.384936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10466): Terminated: ok {rc=0} 20:13:35.429184 --- ParallelTerminationStrategy: PID 10469 died... 20:13:35.447686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10469): Terminated: ok {rc=0} 20:13:35.533153 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:13:36.821028 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:13:36.827455 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:13:36.848493 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:13:36.887912 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:13:36.974314 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:13:36.995323 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:13:37.033765 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:13:37.625964 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:13:37.675442 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:37.686335 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:37.742655 tst cs_paging_gprs_active.py: using LAC 23443 20:13:37.863730 tst cs_paging_gprs_active.py: using RAC 238 20:13:37.985561 tst cs_paging_gprs_active.py: using CellId 23443 20:13:38.114910 tst cs_paging_gprs_active.py: using BVCI 23444 20:13:38.233881 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.245447 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.256603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.268029 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.279327 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.290687 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.302033 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.313134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:38.324445 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:38.441666 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:38.562373 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:13:38.785022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:39.114749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10475): Launched 20:13:39.382478 run iperf3-srv_10.42.42.10(pid=10476): Launched 20:13:39.496840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:13:39.701960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:40.008220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10477): Launched 20:13:40.272763 run iperf3-srv_10.42.42.10(pid=10478): Launched 20:13:40.387080 tst cs_paging_gprs_active.py:38: start network... 20:13:40.592075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:41.066127 run create_hlr_db(pid=10479): Launched 20:13:41.183972 bus /gobi_6: Setting Powered False 20:13:42.245747 run create_hlr_db(pid=10479): Terminated: ok {rc=0} 20:13:42.670213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10481): Launched 20:13:42.975478 run osmo-hlr_10.42.42.2(pid=10482): Launched 20:13:43.092546 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:43.629869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10484): Launched 20:13:43.937177 run osmo-stp_10.42.42.5(pid=10485): Launched 20:13:44.053973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:44.580367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10487): Launched 20:13:44.697200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:44.955502 run patchelf(pid=10488): Launched 20:13:45.125806 run osmo-stp_10.42.42.5(pid=10485): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10485)] 20:13:45.255604 run osmo-stp_10.42.42.5(pid=10485): stdout: | (launched: 2022-12-09_20:13:43.881136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:45.386608 run osmo-stp_10.42.42.5(pid=10485): stderr: | 20221209201344048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201344048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201344048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201344049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201344049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201344049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201344049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:45.517378 run osmo-stp_10.42.42.5(pid=10485): stdout: | (launched: 2022-12-09_20:13:43.881136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:45.642399 run osmo-stp_10.42.42.5(pid=10485): stderr: | 20221209201344048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201344048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201344048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201344049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201344049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201344049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201344049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:45.790854 run patchelf(pid=10488): Terminating (SIGINT) 20:13:45.965886 run patchelf(pid=10488): Terminated: ok {rc=0} 20:13:46.093177 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10485): Process ended prematurely: osmo-stp_10.42.42.5(pid=10485) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10485)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:13:46.103684 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:13:46.134245 run osmo-hlr_10.42.42.2(pid=10482): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10482)] 20:13:46.184637 run osmo-hlr_10.42.42.2(pid=10482): stdout: | (launched: 2022-12-09_20:13:42.919566) 20:13:46.236270 run osmo-hlr_10.42.42.2(pid=10482): stderr: | 20221209201343094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201343094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201343094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201343094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201343094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201343094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201343106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201343117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201343117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201343117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:46.288648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10475): Terminating (SIGTERM) 20:13:46.330545 run iperf3-srv_10.42.42.10(pid=10476): Terminating (SIGTERM) 20:13:46.372452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10477): Terminating (SIGTERM) 20:13:46.415207 run iperf3-srv_10.42.42.10(pid=10478): Terminating (SIGTERM) 20:13:46.460011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10481): Terminating (SIGTERM) 20:13:46.502652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10484): Terminating (SIGTERM) 20:13:46.544709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10487): Terminating (SIGTERM) 20:13:46.586947 --- ParallelTerminationStrategy: PID 10475 died... 20:13:46.606453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10475): Terminated: ok {rc=0} 20:13:46.653686 --- ParallelTerminationStrategy: PID 10476 died... 20:13:46.672901 run iperf3-srv_10.42.42.10(pid=10476): Terminated {rc=256} 20:13:46.720025 --- ParallelTerminationStrategy: PID 10477 died... 20:13:46.739311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10477): Terminated: ok {rc=0} 20:13:46.786259 --- ParallelTerminationStrategy: PID 10478 died... 20:13:46.805689 run iperf3-srv_10.42.42.10(pid=10478): Terminated {rc=256} 20:13:46.852676 --- ParallelTerminationStrategy: PID 10481 died... 20:13:46.872182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10481): Terminated: ok {rc=0} 20:13:46.919207 --- ParallelTerminationStrategy: PID 10484 died... 20:13:46.938715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10484): Terminated: ok {rc=0} 20:13:46.985818 --- ParallelTerminationStrategy: PID 10487 died... 20:13:47.005376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10487): Terminated: ok {rc=0} 20:13:47.097260 bus /gobi_0: Setting Powered False 20:13:48.200012 bus /gobi_0: Setting Powered False 20:13:49.311545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:13:50.460337 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:50.472423 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:50.538799 tst iperf3.py: using LAC 23444 20:13:50.666584 tst iperf3.py: using RAC 239 20:13:50.795523 tst iperf3.py: using CellId 23444 20:13:50.922342 tst iperf3.py: using BVCI 23445 20:13:51.041629 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.052917 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.064022 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.075152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.086374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.097694 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.108899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.119925 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:51.131189 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:13:51.251283 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:13:51.474813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:13:51.805563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10489): Launched 20:13:52.091055 run iperf3-srv_10.42.42.10(pid=10490): Launched 20:13:52.214266 tst iperf3.py:8: start network... 20:13:52.435893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:13:52.943793 run create_hlr_db(pid=10491): Launched 20:13:53.076256 bus /gobi_6: Setting Powered False 20:13:54.140319 run create_hlr_db(pid=10491): Terminated: ok {rc=0} 20:13:54.577997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10493): Launched 20:13:54.885811 run osmo-hlr_10.42.42.2(pid=10494): Launched 20:13:55.001521 run osmo-stp_10.42.42.5: Starting osmo-stp 20:13:55.546610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10496): Launched 20:13:55.852788 run osmo-stp_10.42.42.5(pid=10497): Launched 20:13:55.969756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:13:56.498388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10499): Launched 20:13:56.615695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:13:56.874468 run patchelf(pid=10500): Launched 20:13:57.044284 run osmo-stp_10.42.42.5(pid=10497): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10497)] 20:13:57.174289 run osmo-stp_10.42.42.5(pid=10497): stdout: | (launched: 2022-12-09_20:13:55.796647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:57.305325 run osmo-stp_10.42.42.5(pid=10497): stderr: | 20221209201355965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201355966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201355966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201355966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201355967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201355967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201355967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:57.436517 run osmo-stp_10.42.42.5(pid=10497): stdout: | (launched: 2022-12-09_20:13:55.796647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:13:57.562139 run osmo-stp_10.42.42.5(pid=10497): stderr: | 20221209201355965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201355966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201355966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201355966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201355967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201355967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201355967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:13:57.711264 run patchelf(pid=10500): Terminating (SIGINT) 20:13:57.883407 run patchelf(pid=10500): Terminated: ok {rc=0} 20:13:58.008221 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10497): Process ended prematurely: osmo-stp_10.42.42.5(pid=10497) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10497)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 20:13:58.017973 tst iperf3.py:8: Test FAILED (7.6 sec) 20:13:58.045812 run osmo-hlr_10.42.42.2(pid=10494): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10494)] 20:13:58.093848 run osmo-hlr_10.42.42.2(pid=10494): stdout: | (launched: 2022-12-09_20:13:54.829528) 20:13:58.143654 run osmo-hlr_10.42.42.2(pid=10494): stderr: | 20221209201355005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201355005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201355005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201355005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201355005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201355005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201355019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201355028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201355028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201355028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:13:58.193886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10489): Terminating (SIGTERM) 20:13:58.233902 run iperf3-srv_10.42.42.10(pid=10490): Terminating (SIGTERM) 20:13:58.273712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10493): Terminating (SIGTERM) 20:13:58.313424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10496): Terminating (SIGTERM) 20:13:58.353553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10499): Terminating (SIGTERM) 20:13:58.393676 --- ParallelTerminationStrategy: PID 10489 died... 20:13:58.412764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10489): Terminated: ok {rc=0} 20:13:58.457790 --- ParallelTerminationStrategy: PID 10490 died... 20:13:58.476330 run iperf3-srv_10.42.42.10(pid=10490): Terminated {rc=256} 20:13:58.520347 --- ParallelTerminationStrategy: PID 10493 died... 20:13:58.538888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10493): Terminated: ok {rc=0} 20:13:58.583114 --- ParallelTerminationStrategy: PID 10496 died... 20:13:58.601616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10496): Terminated: ok {rc=0} 20:13:58.645675 --- ParallelTerminationStrategy: PID 10499 died... 20:13:58.664169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10499): Terminated: ok {rc=0} 20:13:58.750577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:13:59.897328 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:13:59.908715 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:13:59.966715 tst iperf3m4.py: using LAC 23445 20:14:00.091351 tst iperf3m4.py: using RAC 240 20:14:00.210848 tst iperf3m4.py: using CellId 23445 20:14:00.332607 tst iperf3m4.py: using BVCI 23446 20:14:00.445585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.456421 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.467112 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.478090 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.488881 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.499897 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.510898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.521722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:00.532763 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:00.651689 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:00.773700 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:00.893691 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:01.017453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:14:01.256400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:01.572830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Launched 20:14:01.846348 run iperf3-srv_10.42.42.10(pid=10502): Launched 20:14:01.979487 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:14:02.191040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:02.502105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10503): Launched 20:14:02.770138 run iperf3-srv_10.42.42.10(pid=10504): Launched 20:14:02.887041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:14:03.092266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:03.400491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10505): Launched 20:14:03.666887 run iperf3-srv_10.42.42.10(pid=10506): Launched 20:14:03.783388 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:14:03.988517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:14:04.295683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10507): Launched 20:14:04.560700 run iperf3-srv_10.42.42.10(pid=10508): Launched 20:14:04.675077 tst iperf3m4.py:8: start network... 20:14:04.879545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:05.355632 run create_hlr_db(pid=10509): Launched 20:14:05.490649 bus /gobi_6: Setting Powered False 20:14:06.555583 run create_hlr_db(pid=10509): Terminated: ok {rc=0} 20:14:07.011766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10511): Launched 20:14:07.339936 run osmo-hlr_10.42.42.2(pid=10512): Launched 20:14:07.464996 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:08.035131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10514): Launched 20:14:08.364499 run osmo-stp_10.42.42.5(pid=10515): Launched 20:14:08.488823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:09.056183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10517): Launched 20:14:09.181954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:09.461450 run patchelf(pid=10518): Launched 20:14:09.644215 run osmo-stp_10.42.42.5(pid=10515): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10515)] 20:14:09.783001 run osmo-stp_10.42.42.5(pid=10515): stdout: | (launched: 2022-12-09_20:14:08.304718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:09.923390 run osmo-stp_10.42.42.5(pid=10515): stderr: | 20221209201408493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201408493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201408493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201408494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201408494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201408494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201408494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:10.063681 run osmo-stp_10.42.42.5(pid=10515): stdout: | (launched: 2022-12-09_20:14:08.304718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:10.198713 run osmo-stp_10.42.42.5(pid=10515): stderr: | 20221209201408493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201408493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201408493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201408494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201408494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201408494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201408494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:10.358692 run patchelf(pid=10518): Terminating (SIGINT) 20:14:10.543050 run patchelf(pid=10518): Terminated: ok {rc=0} 20:14:10.676059 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10515): Process ended prematurely: osmo-stp_10.42.42.5(pid=10515) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10515)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:14:10.686468 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:14:10.715237 run osmo-hlr_10.42.42.2(pid=10512): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10512)] 20:14:10.765393 run osmo-hlr_10.42.42.2(pid=10512): stdout: | (launched: 2022-12-09_20:14:07.280102) 20:14:10.817117 run osmo-hlr_10.42.42.2(pid=10512): stderr: | 20221209201407474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201407474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201407474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201407474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201407474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201407475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201407487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201407496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201407497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201407497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:10.869290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminating (SIGTERM) 20:14:10.911065 run iperf3-srv_10.42.42.10(pid=10502): Terminating (SIGTERM) 20:14:10.952844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10503): Terminating (SIGTERM) 20:14:10.995401 run iperf3-srv_10.42.42.10(pid=10504): Terminating (SIGTERM) 20:14:11.037618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10505): Terminating (SIGTERM) 20:14:11.079835 run iperf3-srv_10.42.42.10(pid=10506): Terminating (SIGTERM) 20:14:11.121893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10507): Terminating (SIGTERM) 20:14:11.163984 run iperf3-srv_10.42.42.10(pid=10508): Terminating (SIGTERM) 20:14:11.206199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10511): Terminating (SIGTERM) 20:14:11.248556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10514): Terminating (SIGTERM) 20:14:11.291012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10517): Terminating (SIGTERM) 20:14:11.333357 --- ParallelTerminationStrategy: PID 10501 died... 20:14:11.353560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminated: ok {rc=0} 20:14:11.400185 --- ParallelTerminationStrategy: PID 10502 died... 20:14:11.420057 run iperf3-srv_10.42.42.10(pid=10502): Terminated {rc=256} 20:14:11.466363 --- ParallelTerminationStrategy: PID 10503 died... 20:14:11.486003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10503): Terminated: ok {rc=0} 20:14:11.532432 --- ParallelTerminationStrategy: PID 10504 died... 20:14:11.552130 run iperf3-srv_10.42.42.10(pid=10504): Terminated {rc=256} 20:14:11.598417 --- ParallelTerminationStrategy: PID 10505 died... 20:14:11.617999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10505): Terminated: ok {rc=0} 20:14:11.664224 --- ParallelTerminationStrategy: PID 10506 died... 20:14:11.683886 run iperf3-srv_10.42.42.10(pid=10506): Terminated {rc=256} 20:14:11.730033 --- ParallelTerminationStrategy: PID 10507 died... 20:14:11.749670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10507): Terminated: ok {rc=0} 20:14:11.796044 --- ParallelTerminationStrategy: PID 10508 died... 20:14:11.815983 run iperf3-srv_10.42.42.10(pid=10508): Terminated {rc=256} 20:14:11.862225 --- ParallelTerminationStrategy: PID 10511 died... 20:14:11.882051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10511): Terminated: ok {rc=0} 20:14:11.928521 --- ParallelTerminationStrategy: PID 10514 died... 20:14:11.948257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10514): Terminated: ok {rc=0} 20:14:11.994533 --- ParallelTerminationStrategy: PID 10517 died... 20:14:12.014243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10517): Terminated: ok {rc=0} 20:14:12.102430 bus /gobi_4: Setting Powered False 20:14:13.202433 bus /gobi_4: Setting Powered False 20:14:14.319089 bus /gobi_1: Setting Powered False 20:14:15.418585 bus /gobi_1: Setting Powered False 20:14:16.542078 bus /gobi_0: Setting Powered False 20:14:17.652903 bus /gobi_0: Setting Powered False 20:14:18.772331 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:14:19.876639 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:19.888696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:14:19.948163 tst ping.py: using LAC 23446 20:14:20.076198 tst ping.py: using RAC 241 20:14:20.203000 tst ping.py: using CellId 23446 20:14:20.330556 tst ping.py: using BVCI 23447 20:14:20.449658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.461053 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.472153 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.483341 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.494424 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.505863 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.517203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:20.528361 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:20.643284 tst ping.py:19: start network... 20:14:20.846106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:21.312812 run create_hlr_db(pid=10519): Launched 20:14:21.429095 bus /gobi_6: Setting Powered False 20:14:22.489076 run create_hlr_db(pid=10519): Terminated: ok {rc=0} 20:14:22.909345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10521): Launched 20:14:23.211132 run osmo-hlr_10.42.42.2(pid=10522): Launched 20:14:23.326214 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:23.849857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10524): Launched 20:14:24.150694 run osmo-stp_10.42.42.5(pid=10525): Launched 20:14:24.265961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:24.785019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10527): Launched 20:14:24.900360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:25.154120 run patchelf(pid=10528): Launched 20:14:25.320393 run osmo-stp_10.42.42.5(pid=10525): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10525)] 20:14:25.447857 run osmo-stp_10.42.42.5(pid=10525): stdout: | (launched: 2022-12-09_20:14:24.094681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:25.577123 run osmo-stp_10.42.42.5(pid=10525): stderr: | 20221209201424263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201424263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201424263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201424264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201424264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201424264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201424264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:25.705837 run osmo-stp_10.42.42.5(pid=10525): stdout: | (launched: 2022-12-09_20:14:24.094681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:25.828787 run osmo-stp_10.42.42.5(pid=10525): stderr: | 20221209201424263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201424263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201424263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201424264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201424264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201424264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201424264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:25.974774 run patchelf(pid=10528): Terminating (SIGINT) 20:14:26.143390 run patchelf(pid=10528): Terminated: ok {rc=0} 20:14:26.264612 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10525): Process ended prematurely: osmo-stp_10.42.42.5(pid=10525) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10525)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 20:14:26.273836 tst ping.py:22: Test FAILED (6.4 sec) 20:14:26.301015 run osmo-hlr_10.42.42.2(pid=10522): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10522)] 20:14:26.349442 run osmo-hlr_10.42.42.2(pid=10522): stdout: | (launched: 2022-12-09_20:14:23.155694) 20:14:26.399134 run osmo-hlr_10.42.42.2(pid=10522): stderr: | 20221209201423330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201423330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201423330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201423331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201423331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201423331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201423343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201423351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201423351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201423351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:26.449339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10521): Terminating (SIGTERM) 20:14:26.489053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10524): Terminating (SIGTERM) 20:14:26.528732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10527): Terminating (SIGTERM) 20:14:26.568572 --- ParallelTerminationStrategy: PID 10521 died... 20:14:26.587527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10521): Terminated: ok {rc=0} 20:14:26.631512 --- ParallelTerminationStrategy: PID 10524 died... 20:14:26.650056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10524): Terminated: ok {rc=0} 20:14:26.694606 --- ParallelTerminationStrategy: PID 10527 died... 20:14:26.713345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10527): Terminated: ok {rc=0} 20:14:26.799771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:14:27.889323 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:27.901315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:14:27.959680 tst ping_idle_ping.py: using LAC 23447 20:14:28.089341 tst ping_idle_ping.py: using RAC 242 20:14:28.217330 tst ping_idle_ping.py: using CellId 23447 20:14:28.346332 tst ping_idle_ping.py: using BVCI 23448 20:14:28.464785 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.476357 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.487620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.499602 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.511841 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.523658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.535968 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:14:28.547616 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:14:28.666038 tst ping_idle_ping.py:24: start network... 20:14:28.868633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:29.338685 run create_hlr_db(pid=10529): Launched 20:14:29.453903 bus /gobi_6: Setting Powered False 20:14:30.514366 run create_hlr_db(pid=10529): Terminated: ok {rc=0} 20:14:30.978042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10531): Launched 20:14:31.299210 run osmo-hlr_10.42.42.2(pid=10532): Launched 20:14:31.458208 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:32.116295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10534): Launched 20:14:32.437635 run osmo-stp_10.42.42.5(pid=10535): Launched 20:14:32.552188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:33.071003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10537): Launched 20:14:33.185661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:33.440191 run patchelf(pid=10538): Launched 20:14:33.607605 run osmo-stp_10.42.42.5(pid=10535): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10535)] 20:14:33.734928 run osmo-stp_10.42.42.5(pid=10535): stdout: | (launched: 2022-12-09_20:14:32.382184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:33.864159 run osmo-stp_10.42.42.5(pid=10535): stderr: | 20221209201432552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201432553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201432553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201432553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201432554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201432554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201432554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:33.993676 run osmo-stp_10.42.42.5(pid=10535): stdout: | (launched: 2022-12-09_20:14:32.382184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:34.116792 run osmo-stp_10.42.42.5(pid=10535): stderr: | 20221209201432552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201432553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201432553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201432553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201432554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201432554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201432554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:34.262745 run patchelf(pid=10538): Terminating (SIGINT) 20:14:34.431950 run patchelf(pid=10538): Terminated: ok {rc=0} 20:14:34.553876 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10535): Process ended prematurely: osmo-stp_10.42.42.5(pid=10535) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10535)] [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:14:34.562901 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:14:34.590035 run osmo-hlr_10.42.42.2(pid=10532): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10532)] 20:14:34.637470 run osmo-hlr_10.42.42.2(pid=10532): stdout: | (launched: 2022-12-09_20:14:31.243757) 20:14:34.686813 run osmo-hlr_10.42.42.2(pid=10532): stderr: | 20221209201431621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201431621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201431621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201431621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201431621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201431621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201431647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201431666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201431666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201431666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:34.737408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10531): Terminating (SIGTERM) 20:14:34.777462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10534): Terminating (SIGTERM) 20:14:34.817370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10537): Terminating (SIGTERM) 20:14:34.857502 --- ParallelTerminationStrategy: PID 10531 died... 20:14:34.876519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10531): Terminated: ok {rc=0} 20:14:34.920875 --- ParallelTerminationStrategy: PID 10534 died... 20:14:34.939972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10534): Terminated: ok {rc=0} 20:14:34.983960 --- ParallelTerminationStrategy: PID 10537 died... 20:14:35.002520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10537): Terminated: ok {rc=0} 20:14:35.087625 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:14:36.375992 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:36.382289 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:14:36.402866 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:14:36.437527 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:14:36.490566 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:14:36.510959 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:14:36.545464 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:14:37.102701 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:14:37.107676 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.118835 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:14:37.174970 tst switch_tch_pdch.py: using LAC 23448 20:14:37.298528 tst switch_tch_pdch.py: using RAC 243 20:14:37.416115 tst switch_tch_pdch.py: using CellId 23448 20:14:37.532663 tst switch_tch_pdch.py: using BVCI 23449 20:14:37.641335 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.652418 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.663420 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.674584 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.685829 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.696909 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.708118 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:14:37.719419 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:14:37.840372 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:14:37.957559 tst switch_tch_pdch.py:51: start network... 20:14:38.159046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:38.628028 run create_hlr_db(pid=10543): Launched 20:14:38.760139 bus /gobi_6: Setting Powered False 20:14:39.823934 run create_hlr_db(pid=10543): Terminated: ok {rc=0} 20:14:40.255327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Launched 20:14:40.555719 run osmo-hlr_10.42.42.2(pid=10546): Launched 20:14:40.669777 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:41.199927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Launched 20:14:41.499987 run osmo-stp_10.42.42.5(pid=10549): Launched 20:14:41.613741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:42.131914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10551): Launched 20:14:42.246884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:42.500916 run patchelf(pid=10552): Launched 20:14:42.667872 run osmo-stp_10.42.42.5(pid=10549): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] 20:14:42.795202 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-09_20:14:41.444624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:42.924212 run osmo-stp_10.42.42.5(pid=10549): stderr: | 20221209201441617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201441617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201441617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201441618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201441618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201441618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201441618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:43.053559 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-09_20:14:41.444624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:43.176632 run osmo-stp_10.42.42.5(pid=10549): stderr: | 20221209201441617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201441617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201441617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201441618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201441618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201441618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201441618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:43.322731 run patchelf(pid=10552): Terminating (SIGINT) 20:14:43.492578 run patchelf(pid=10552): Terminated: ok {rc=0} 20:14:43.615662 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2364↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] [trial-2364↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:14:43.624662 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 20:14:43.652115 run osmo-hlr_10.42.42.2(pid=10546): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10546)] 20:14:43.700328 run osmo-hlr_10.42.42.2(pid=10546): stdout: | (launched: 2022-12-09_20:14:40.500615) 20:14:43.750152 run osmo-hlr_10.42.42.2(pid=10546): stderr: | 20221209201440678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201440678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201440678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201440678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201440678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201440678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201440690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201440699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201440700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201440700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:43.800455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminating (SIGTERM) 20:14:43.840763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminating (SIGTERM) 20:14:43.881012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10551): Terminating (SIGTERM) 20:14:43.921574 --- ParallelTerminationStrategy: PID 10545 died... 20:14:43.940772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminated: ok {rc=0} 20:14:43.985734 --- ParallelTerminationStrategy: PID 10548 died... 20:14:44.004474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminated: ok {rc=0} 20:14:44.048635 --- ParallelTerminationStrategy: PID 10551 died... 20:14:44.067241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10551): Terminated: ok {rc=0} 20:14:44.151004 bus /gobi_0: Setting Powered False 20:14:45.248674 bus /gobi_0: Setting Powered False 20:14:46.367966 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:14:47.603892 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:47.609520 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:14:47.630415 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:14:47.664993 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:14:47.719112 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:14:47.740770 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:14:47.775305 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:14:48.331004 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:14:48.336486 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.347991 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:14:48.405491 tst switch_tch_pdch.py: using LAC 23449 20:14:48.532359 tst switch_tch_pdch.py: using RAC 244 20:14:48.652771 tst switch_tch_pdch.py: using CellId 23449 20:14:48.770660 tst switch_tch_pdch.py: using BVCI 23450 20:14:48.881109 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.891974 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.902662 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.913635 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.924456 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.935670 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.946726 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:14:48.957588 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:14:49.079438 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:14:49.195310 tst switch_tch_pdch.py:51: start network... 20:14:49.397168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:14:49.838037 run create_hlr_db(pid=10556): Launched 20:14:49.953820 bus /gobi_6: Setting Powered False 20:14:51.013787 run create_hlr_db(pid=10556): Terminated: ok {rc=0} 20:14:51.427384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Launched 20:14:51.753583 run osmo-hlr_10.42.42.2(pid=10560): Launched 20:14:51.879030 run osmo-stp_10.42.42.5: Starting osmo-stp 20:14:52.405673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10562): Launched 20:14:52.729434 run osmo-stp_10.42.42.5(pid=10563): Launched 20:14:52.852226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:14:53.381450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10565): Launched 20:14:53.505572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:14:53.778727 run patchelf(pid=10566): Launched 20:14:53.958741 run osmo-stp_10.42.42.5(pid=10563): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10563)] 20:14:54.095239 run osmo-stp_10.42.42.5(pid=10563): stdout: | (launched: 2022-12-09_20:14:52.670792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:54.233563 run osmo-stp_10.42.42.5(pid=10563): stderr: | 20221209201452862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201452862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201452862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201452863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201452863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201452863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201452863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:54.371961 run osmo-stp_10.42.42.5(pid=10563): stdout: | (launched: 2022-12-09_20:14:52.670792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:14:54.504035 run osmo-stp_10.42.42.5(pid=10563): stderr: | 20221209201452862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201452862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201452862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201452863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201452863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201452863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201452863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:14:54.661900 run patchelf(pid=10566): Terminating (SIGINT) 20:14:54.842369 run patchelf(pid=10566): Terminated: ok {rc=0} 20:14:54.972513 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10563): Process ended prematurely: osmo-stp_10.42.42.5(pid=10563) [trial-2364↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10563)] [trial-2364↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:14:54.982274 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:14:55.010681 run osmo-hlr_10.42.42.2(pid=10560): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10560)] 20:14:55.061278 run osmo-hlr_10.42.42.2(pid=10560): stdout: | (launched: 2022-12-09_20:14:51.694995) 20:14:55.113299 run osmo-hlr_10.42.42.2(pid=10560): stderr: | 20221209201451895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201451895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201451895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201451895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201451895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201451895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201451908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201451917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201451918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201451918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:14:55.165748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminating (SIGTERM) 20:14:55.208071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10562): Terminating (SIGTERM) 20:14:55.250400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10565): Terminating (SIGTERM) 20:14:55.293062 --- ParallelTerminationStrategy: PID 10558 died... 20:14:55.313216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminated: ok {rc=0} 20:14:55.360031 --- ParallelTerminationStrategy: PID 10562 died... 20:14:55.379795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10562): Terminated: ok {rc=0} 20:14:55.426649 --- ParallelTerminationStrategy: PID 10565 died... 20:14:55.446456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10565): Terminated: ok {rc=0} 20:14:55.534946 bus /gobi_0: Setting Powered False 20:14:56.635145 bus /gobi_0: Setting Powered False 20:14:57.753803 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:oc2g --------------------------------------------------------------------- 20:14:58.995943 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:14:59.000191 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 20:14:59.021234 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 20:14:59.028840 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 20:14:59.085367 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 20:14:59.107071 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 20:14:59.114512 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 20:14:59.645532 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:14:59.651267 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 20:14:59.662291 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 20:14:59.698487 tst mo_mt_sms.py: using LAC 23450 20:14:59.815790 tst mo_mt_sms.py: using RAC 245 20:14:59.933386 tst mo_mt_sms.py: using CellId 23450 20:15:00.049820 tst mo_mt_sms.py: using BVCI 23451 20:15:00.159864 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:15:00.279428 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 20:15:00.399836 tst mo_mt_sms.py:9: start nitb and bts... 20:15:00.618890 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:15:01.329466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10573): Launched 20:15:01.672505 run osmo-nitb_10.42.42.2(pid=10574): Launched 20:15:01.903412 run osmo-nitb_10.42.42.2(pid=10574): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10574)] 20:15:02.050869 run osmo-nitb_10.42.42.2(pid=10574): stdout: | (launched: 2022-12-09_20:15:01.608781) 20:15:02.199377 run osmo-nitb_10.42.42.2(pid=10574): stderr: | (launched: 2022-12-09_20:15:01.658476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:02.346722 run osmo-nitb_10.42.42.2(pid=10574): stdout: | (launched: 2022-12-09_20:15:01.608781) 20:15:02.487421 run osmo-nitb_10.42.42.2(pid=10574): stderr: | (launched: 2022-12-09_20:15:01.658476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10574): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10574) [trial-2364↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10574)] 20:15:02.825618 tst osmo-nitb_10.42.42.2(pid=10574): stdout: | (launched: 2022-12-09_20:15:01.608781) 20:15:02.955046 tst osmo-nitb_10.42.42.2(pid=10574): stderr: | (launched: 2022-12-09_20:15:01.658476) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:03.108171 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10574): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10574) [trial-2364↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10574)] [trial-2364↪nitb_sms:oc2g↪mo_mt_sms.py:11] 20:15:03.117236 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 20:15:03.124167 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10573): Terminating (SIGTERM) 20:15:03.334751 --- ParallelTerminationStrategy: PID 10573 died... 20:15:03.356429 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10573): Terminated: ok {rc=0} 20:15:03.445142 bus /sierra_3: Setting Powered False 20:15:04.546039 bus /sierra_3: Setting Powered False 20:15:05.666523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:oc2g --------------------------------------------------------------------- 20:15:06.849861 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:06.854178 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 20:15:06.875272 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 20:15:06.902428 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 20:15:06.955404 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 20:15:06.977744 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 20:15:07.005270 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 20:15:07.550215 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:oc2g mo_mt_sms.py ---------------------------------------------- 20:15:07.555299 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:07.566183 tst sms:oc2g: Using 1 x bts (candidates: 1) 20:15:07.600696 tst mo_mt_sms.py: using LAC 23451 20:15:07.726776 tst mo_mt_sms.py: using RAC 246 20:15:07.847325 tst mo_mt_sms.py: using CellId 23451 20:15:07.966473 tst mo_mt_sms.py: using BVCI 23452 20:15:08.077420 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:08.087946 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:08.098567 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:08.109869 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:08.120582 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 20:15:08.131383 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:15:08.247888 tst sms:oc2g: Using 1 x modem (candidates: 2) 20:15:08.363073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:08.828172 run create_hlr_db(pid=10578): Launched 20:15:08.942744 bus /sierra_2: Setting Powered False 20:15:10.002980 run create_hlr_db(pid=10578): Terminated: ok {rc=0} 20:15:10.423130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10580): Launched 20:15:10.724266 run osmo-hlr_10.42.42.2(pid=10581): Launched 20:15:10.838961 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:11.370734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10583): Launched 20:15:11.670726 run osmo-stp_10.42.42.5(pid=10584): Launched 20:15:11.786605 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:12.329003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10586): Launched 20:15:12.628883 run osmo-msc_10.42.42.6(pid=10587): Launched 20:15:12.796491 run osmo-stp_10.42.42.5(pid=10584): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10584)] 20:15:12.923419 run osmo-stp_10.42.42.5(pid=10584): stdout: | (launched: 2022-12-09_20:15:11.615815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:13.051124 run osmo-stp_10.42.42.5(pid=10584): stderr: | 20221209201511786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201511786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201511786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201511787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201511787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201511787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201511787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:13.176464 run osmo-stp_10.42.42.5(pid=10584): stdout: | (launched: 2022-12-09_20:15:11.615815) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:13.295805 run osmo-stp_10.42.42.5(pid=10584): stderr: | 20221209201511786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201511786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201511786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201511787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201511787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201511787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201511787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:13.438908 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10584): Process ended prematurely: osmo-stp_10.42.42.5(pid=10584) [trial-2364↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10584)] [trial-2364↪sms:oc2g↪mo_mt_sms.py:16] 20:15:13.447564 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 20:15:13.473772 run osmo-hlr_10.42.42.2(pid=10581): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10581)] 20:15:13.521355 run osmo-hlr_10.42.42.2(pid=10581): stdout: | (launched: 2022-12-09_20:15:10.669062) 20:15:13.570876 run osmo-hlr_10.42.42.2(pid=10581): stderr: | 20221209201510847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201510847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201510847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201510847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201510847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201510847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201510859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201510868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201510868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201510868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:13.639210 run osmo-msc_10.42.42.6(pid=10587): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10587)] 20:15:13.686701 run osmo-msc_10.42.42.6(pid=10587): stdout: | (launched: 2022-12-09_20:15:12.573681) 20:15:13.735730 run osmo-msc_10.42.42.6(pid=10587): stderr: | 20221209201512846 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201512846 DLGLOBAL DEBUG validating counter group 0x7f30b669dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201512846 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201512846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201512846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201512846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201512848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201512849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201512849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201512849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:13.785513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10580): Terminating (SIGTERM) 20:15:13.825142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10583): Terminating (SIGTERM) 20:15:13.864409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10586): Terminating (SIGTERM) 20:15:13.904268 --- ParallelTerminationStrategy: PID 10580 died... 20:15:13.923405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10580): Terminated: ok {rc=0} 20:15:13.967872 --- ParallelTerminationStrategy: PID 10583 died... 20:15:13.986476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10583): Terminated: ok {rc=0} 20:15:14.031566 --- ParallelTerminationStrategy: PID 10586 died... 20:15:14.050424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10586): Terminated: ok {rc=0} 20:15:14.136542 bus /sierra_3: Setting Powered False 20:15:15.235727 bus /sierra_3: Setting Powered False 20:15:16.356437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:oc2g --------------------------------------------------------------------- 20:15:17.590568 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:17.595151 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:15:17.617046 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 20:15:17.624172 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:15:17.656770 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:15:17.677173 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 20:15:17.683822 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:15:18.208180 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 20:15:18.214279 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 20:15:18.225861 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 20:15:18.260891 tst assert_extension.py: using LAC 23452 20:15:18.385513 tst assert_extension.py: using RAC 247 20:15:18.504351 tst assert_extension.py: using CellId 23452 20:15:18.622122 tst assert_extension.py: using BVCI 23453 20:15:18.732218 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 20:15:18.849816 tst assert_extension.py:10: start nitb and bts... 20:15:19.068473 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:15:19.724870 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10592): Launched 20:15:20.047494 run osmo-nitb_10.42.42.2(pid=10593): Launched 20:15:20.226252 run osmo-nitb_10.42.42.2(pid=10593): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10593)] 20:15:20.370707 run osmo-nitb_10.42.42.2(pid=10593): stdout: | (launched: 2022-12-09_20:15:19.988741) 20:15:20.517053 run osmo-nitb_10.42.42.2(pid=10593): stderr: | (launched: 2022-12-09_20:15:20.036874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:20.663418 run osmo-nitb_10.42.42.2(pid=10593): stdout: | (launched: 2022-12-09_20:15:19.988741) 20:15:20.804010 run osmo-nitb_10.42.42.2(pid=10593): stderr: | (launched: 2022-12-09_20:15:20.036874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10593): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10593) [trial-2364↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10593)] 20:15:21.169173 tst osmo-nitb_10.42.42.2(pid=10593): stdout: | (launched: 2022-12-09_20:15:19.988741) 20:15:21.299323 tst osmo-nitb_10.42.42.2(pid=10593): stderr: | (launched: 2022-12-09_20:15:20.036874) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:15:21.453365 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10593): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10593) [trial-2364↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10593)] [trial-2364↪nitb_ussd:oc2g↪assert_extension.py:12] 20:15:21.462583 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:15:21.469970 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10592): Terminating (SIGTERM) 20:15:21.680828 --- ParallelTerminationStrategy: PID 10592 died... 20:15:21.702339 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10592): Terminated: ok {rc=0} 20:15:21.790650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:oc2g --------------------------------------------------------------------- 20:15:22.954509 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:22.959241 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 20:15:22.979724 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 20:15:23.006723 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 20:15:23.042616 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 20:15:23.063214 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 20:15:23.089971 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 20:15:23.616272 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:oc2g assert_extension.py ---------------------------------------------- 20:15:23.622657 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:23.634314 tst ussd:oc2g: Using 1 x bts (candidates: 1) 20:15:23.668475 tst assert_extension.py: using LAC 23453 20:15:23.799666 tst assert_extension.py: using RAC 248 20:15:23.925966 tst assert_extension.py: using CellId 23453 20:15:24.050968 tst assert_extension.py: using BVCI 23454 20:15:24.168066 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:24.179450 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:24.190361 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:24.201336 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:24.212238 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 20:15:24.223187 tst ussd:oc2g: Using 1 x modem (candidates: 1) 20:15:24.337797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:24.806330 run create_hlr_db(pid=10597): Launched 20:15:24.923497 bus /sierra_2: Setting Powered False 20:15:25.983619 run create_hlr_db(pid=10597): Terminated: ok {rc=0} 20:15:26.403213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Launched 20:15:26.705098 run osmo-hlr_10.42.42.2(pid=10600): Launched 20:15:26.820534 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:27.361152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Launched 20:15:27.664034 run osmo-stp_10.42.42.5(pid=10603): Launched 20:15:27.779585 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:28.323046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10605): Launched 20:15:28.623652 run osmo-msc_10.42.42.6(pid=10606): Launched 20:15:28.791431 run osmo-stp_10.42.42.5(pid=10603): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] 20:15:28.919244 run osmo-stp_10.42.42.5(pid=10603): stdout: | (launched: 2022-12-09_20:15:27.608697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:29.047443 run osmo-stp_10.42.42.5(pid=10603): stderr: | 20221209201527779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201527779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201527780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201527780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201527780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201527780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201527781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:29.172934 run osmo-stp_10.42.42.5(pid=10603): stdout: | (launched: 2022-12-09_20:15:27.608697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:29.293131 run osmo-stp_10.42.42.5(pid=10603): stderr: | 20221209201527779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201527779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201527780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201527780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201527780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201527780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201527781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:29.436433 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10603): Process ended prematurely: osmo-stp_10.42.42.5(pid=10603) [trial-2364↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] [trial-2364↪ussd:oc2g↪assert_extension.py:17] 20:15:29.444931 tst assert_extension.py:17: Test FAILED (5.8 sec) 20:15:29.471170 run osmo-hlr_10.42.42.2(pid=10600): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10600)] 20:15:29.518797 run osmo-hlr_10.42.42.2(pid=10600): stdout: | (launched: 2022-12-09_20:15:26.649715) 20:15:29.567847 run osmo-hlr_10.42.42.2(pid=10600): stderr: | 20221209201526828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201526828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201526828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201526828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201526828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201526828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201526840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201526848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201526848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201526848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:29.636179 run osmo-msc_10.42.42.6(pid=10606): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10606)] 20:15:29.683744 run osmo-msc_10.42.42.6(pid=10606): stdout: | (launched: 2022-12-09_20:15:28.568391) 20:15:29.732625 run osmo-msc_10.42.42.6(pid=10606): stderr: | 20221209201528839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201528839 DLGLOBAL DEBUG validating counter group 0x7fe2c9f43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201528839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201528839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201528839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201528839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201528841 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201528842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201528842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201528842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:29.782082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Terminating (SIGTERM) 20:15:29.821387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Terminating (SIGTERM) 20:15:29.860527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10605): Terminating (SIGTERM) 20:15:29.900521 --- ParallelTerminationStrategy: PID 10599 died... 20:15:29.919530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10599): Terminated: ok {rc=0} 20:15:29.963519 --- ParallelTerminationStrategy: PID 10602 died... 20:15:29.981966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10602): Terminated: ok {rc=0} 20:15:30.025469 --- ParallelTerminationStrategy: PID 10605 died... 20:15:30.043829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10605): Terminated: ok {rc=0} 20:15:30.129808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:15:31.331851 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:31.338743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:15:31.361936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:15:31.391299 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:15:31.442887 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:15:31.471159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:15:31.500280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:15:32.072317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:15:32.144010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.155497 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:15:32.211891 tst mo_mt_call.py: using LAC 23454 20:15:32.342687 tst mo_mt_call.py: using RAC 249 20:15:32.488187 tst mo_mt_call.py: using CellId 23454 20:15:32.622300 tst mo_mt_call.py: using BVCI 23455 20:15:32.743297 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.755095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.766499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.778532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.790529 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:32.802305 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:32.921887 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:33.042613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:33.553294 run create_hlr_db(pid=10611): Launched 20:15:33.686567 bus /sierra_2: Setting Powered False 20:15:34.751338 run create_hlr_db(pid=10611): Terminated: ok {rc=0} 20:15:35.189472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Launched 20:15:35.496887 run osmo-hlr_10.42.42.2(pid=10614): Launched 20:15:35.615238 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:36.159453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Launched 20:15:36.464880 run osmo-stp_10.42.42.5(pid=10617): Launched 20:15:36.583394 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:37.137601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10619): Launched 20:15:37.443289 run osmo-msc_10.42.42.6(pid=10620): Launched 20:15:37.618102 run osmo-stp_10.42.42.5(pid=10617): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] 20:15:37.748221 run osmo-stp_10.42.42.5(pid=10617): stdout: | (launched: 2022-12-09_20:15:36.408925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:37.877456 run osmo-stp_10.42.42.5(pid=10617): stderr: | 20221209201536581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201536581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201536581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201536581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201536582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201536582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201536582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:38.004884 run osmo-stp_10.42.42.5(pid=10617): stdout: | (launched: 2022-12-09_20:15:36.408925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:38.126777 run osmo-stp_10.42.42.5(pid=10617): stderr: | 20221209201536581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201536581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201536581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201536581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201536582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201536582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201536582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:38.272641 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10617): Process ended prematurely: osmo-stp_10.42.42.5(pid=10617) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:15:38.281782 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:15:38.308634 run osmo-hlr_10.42.42.2(pid=10614): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10614)] 20:15:38.356245 run osmo-hlr_10.42.42.2(pid=10614): stdout: | (launched: 2022-12-09_20:15:35.440172) 20:15:38.405356 run osmo-hlr_10.42.42.2(pid=10614): stderr: | 20221209201535617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201535617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201535617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201535617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201535617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201535617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201535630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201535639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201535639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201535639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:38.474132 run osmo-msc_10.42.42.6(pid=10620): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10620)] 20:15:38.521614 run osmo-msc_10.42.42.6(pid=10620): stdout: | (launched: 2022-12-09_20:15:37.387249) 20:15:38.571075 run osmo-msc_10.42.42.6(pid=10620): stderr: | 20221209201537658 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201537658 DLGLOBAL DEBUG validating counter group 0x7facd8591c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201537658 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201537658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201537659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201537659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201537660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201537661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201537661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201537661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:38.620533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Terminating (SIGTERM) 20:15:38.660249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Terminating (SIGTERM) 20:15:38.699868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10619): Terminating (SIGTERM) 20:15:38.739672 --- ParallelTerminationStrategy: PID 10613 died... 20:15:38.758658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10613): Terminated: ok {rc=0} 20:15:38.802545 --- ParallelTerminationStrategy: PID 10616 died... 20:15:38.820811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10616): Terminated: ok {rc=0} 20:15:38.865309 --- ParallelTerminationStrategy: PID 10619 died... 20:15:38.883722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10619): Terminated: ok {rc=0} 20:15:38.966682 bus /sierra_3: Setting Powered False 20:15:40.061575 bus /sierra_3: Setting Powered False 20:15:41.176446 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:15:42.323444 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.335122 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:15:42.391400 tst mo_mt_call_osmux.py: using LAC 23455 20:15:42.513737 tst mo_mt_call_osmux.py: using RAC 250 20:15:42.644050 tst mo_mt_call_osmux.py: using CellId 23455 20:15:42.774476 tst mo_mt_call_osmux.py: using BVCI 23456 20:15:42.893735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.905484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.917251 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.928734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.940110 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:15:42.951473 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:43.067567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:15:43.187289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:43.697584 run create_hlr_db(pid=10622): Launched 20:15:43.832227 bus /sierra_2: Setting Powered False 20:15:44.897181 run create_hlr_db(pid=10622): Terminated: ok {rc=0} 20:15:45.334760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Launched 20:15:45.640771 run osmo-hlr_10.42.42.2(pid=10625): Launched 20:15:45.757706 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:46.477211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Launched 20:15:46.851449 run osmo-stp_10.42.42.5(pid=10628): Launched 20:15:47.016397 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:47.794542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Launched 20:15:48.123315 run osmo-msc_10.42.42.6(pid=10631): Launched 20:15:48.306449 run osmo-stp_10.42.42.5(pid=10628): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] 20:15:48.444888 run osmo-stp_10.42.42.5(pid=10628): stdout: | (launched: 2022-12-09_20:15:46.794924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:48.583394 run osmo-stp_10.42.42.5(pid=10628): stderr: | 20221209201547170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201547170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201547171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201547171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201547172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201547172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201547172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:48.720250 run osmo-stp_10.42.42.5(pid=10628): stdout: | (launched: 2022-12-09_20:15:46.794924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:48.851042 run osmo-stp_10.42.42.5(pid=10628): stderr: | 20221209201547170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201547170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201547171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201547171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201547172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201547172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201547172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:49.007578 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10628): Process ended prematurely: osmo-stp_10.42.42.5(pid=10628) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:15:49.017367 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:15:49.045368 run osmo-hlr_10.42.42.2(pid=10625): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10625)] 20:15:49.095253 run osmo-hlr_10.42.42.2(pid=10625): stdout: | (launched: 2022-12-09_20:15:45.584791) 20:15:49.146803 run osmo-hlr_10.42.42.2(pid=10625): stderr: | 20221209201545762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201545762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201545762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201545762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201545762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201545762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201545773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201545782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201545782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201545782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:15:49.219107 run osmo-msc_10.42.42.6(pid=10631): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10631)] 20:15:49.268831 run osmo-msc_10.42.42.6(pid=10631): stdout: | (launched: 2022-12-09_20:15:48.063708) 20:15:49.320398 run osmo-msc_10.42.42.6(pid=10631): stderr: | 20221209201548386 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201548386 DLGLOBAL DEBUG validating counter group 0x7f3ca216ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201548387 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201548387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201548387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201548387 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201548389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201548389 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201548389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201548389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:15:49.372204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Terminating (SIGTERM) 20:15:49.413315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Terminating (SIGTERM) 20:15:49.454488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Terminating (SIGTERM) 20:15:49.496036 --- ParallelTerminationStrategy: PID 10624 died... 20:15:49.515928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Terminated: ok {rc=0} 20:15:49.562292 --- ParallelTerminationStrategy: PID 10627 died... 20:15:49.581798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Terminated: ok {rc=0} 20:15:49.627789 --- ParallelTerminationStrategy: PID 10630 died... 20:15:49.647200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Terminated: ok {rc=0} 20:15:49.734407 bus /sierra_3: Setting Powered False 20:15:50.833889 bus /sierra_3: Setting Powered False 20:15:51.948755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:15:53.184719 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:15:53.191608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:15:53.212626 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:15:53.239841 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:15:53.292616 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:15:53.313638 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:15:53.340673 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:15:53.893330 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:15:53.945993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:53.957447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:15:54.015244 tst mo_mt_call.py: using LAC 23456 20:15:54.145114 tst mo_mt_call.py: using RAC 251 20:15:54.274107 tst mo_mt_call.py: using CellId 23456 20:15:54.404268 tst mo_mt_call.py: using BVCI 23457 20:15:54.517127 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.528304 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.540273 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.551935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.562974 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:15:54.574458 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:54.696004 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:15:54.813852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:15:55.290533 run create_hlr_db(pid=10637): Launched 20:15:55.407663 bus /sierra_2: Setting Powered False 20:15:56.468518 run create_hlr_db(pid=10637): Terminated: ok {rc=0} 20:15:56.897395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10639): Launched 20:15:57.204552 run osmo-hlr_10.42.42.2(pid=10640): Launched 20:15:57.322406 run osmo-stp_10.42.42.5: Starting osmo-stp 20:15:57.850579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Launched 20:15:58.157236 run osmo-stp_10.42.42.5(pid=10643): Launched 20:15:58.275279 run osmo-msc_10.42.42.6: Starting osmo-msc 20:15:58.830223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Launched 20:15:59.138886 run osmo-msc_10.42.42.6(pid=10646): Launched 20:15:59.310819 run osmo-stp_10.42.42.5(pid=10643): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10643)] 20:15:59.440877 run osmo-stp_10.42.42.5(pid=10643): stdout: | (launched: 2022-12-09_20:15:58.101116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:59.570277 run osmo-stp_10.42.42.5(pid=10643): stderr: | 20221209201558269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201558269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201558269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201558270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201558270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201558270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201558270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:59.697945 run osmo-stp_10.42.42.5(pid=10643): stdout: | (launched: 2022-12-09_20:15:58.101116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:15:59.820018 run osmo-stp_10.42.42.5(pid=10643): stderr: | 20221209201558269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201558269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201558269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201558270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201558270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201558270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201558270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:15:59.966247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10643): Process ended prematurely: osmo-stp_10.42.42.5(pid=10643) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10643)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:15:59.975229 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:16:00.002166 run osmo-hlr_10.42.42.2(pid=10640): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10640)] 20:16:00.050453 run osmo-hlr_10.42.42.2(pid=10640): stdout: | (launched: 2022-12-09_20:15:57.148317) 20:16:00.100098 run osmo-hlr_10.42.42.2(pid=10640): stderr: | 20221209201557326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201557326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201557326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201557326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201557327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201557327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201557339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201557350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201557350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201557350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:00.169741 run osmo-msc_10.42.42.6(pid=10646): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10646)] 20:16:00.217718 run osmo-msc_10.42.42.6(pid=10646): stdout: | (launched: 2022-12-09_20:15:59.082651) 20:16:00.267348 run osmo-msc_10.42.42.6(pid=10646): stderr: | 20221209201559353 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201559354 DLGLOBAL DEBUG validating counter group 0x7fb5d7ef9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201559354 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201559354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201559354 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201559354 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201559356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201559356 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201559356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201559356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:00.317616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10639): Terminating (SIGTERM) 20:16:00.357335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Terminating (SIGTERM) 20:16:00.396917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Terminating (SIGTERM) 20:16:00.437181 --- ParallelTerminationStrategy: PID 10639 died... 20:16:00.456491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10639): Terminated: ok {rc=0} 20:16:00.500254 --- ParallelTerminationStrategy: PID 10642 died... 20:16:00.518780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Terminated: ok {rc=0} 20:16:00.561910 --- ParallelTerminationStrategy: PID 10645 died... 20:16:00.580362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Terminated: ok {rc=0} 20:16:00.666829 bus /sierra_3: Setting Powered False 20:16:01.764487 bus /sierra_3: Setting Powered False 20:16:02.877666 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:16:04.026915 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.039178 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:16:04.097743 tst mo_mt_call_osmux.py: using LAC 23457 20:16:04.229100 tst mo_mt_call_osmux.py: using RAC 252 20:16:04.357635 tst mo_mt_call_osmux.py: using CellId 23457 20:16:04.486659 tst mo_mt_call_osmux.py: using BVCI 23458 20:16:04.607961 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.619567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.630890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.642240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.653552 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:16:04.664999 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:04.785792 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:16:04.905979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:05.382097 run create_hlr_db(pid=10648): Launched 20:16:05.499550 bus /sierra_2: Setting Powered False 20:16:06.560130 run create_hlr_db(pid=10648): Terminated: ok {rc=0} 20:16:07.008787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Launched 20:16:07.337715 run osmo-hlr_10.42.42.2(pid=10651): Launched 20:16:07.462974 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:08.029164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Launched 20:16:08.358269 run osmo-stp_10.42.42.5(pid=10654): Launched 20:16:08.482999 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:09.076614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Launched 20:16:09.405173 run osmo-msc_10.42.42.6(pid=10657): Launched 20:16:09.589252 run osmo-stp_10.42.42.5(pid=10654): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] 20:16:09.727046 run osmo-stp_10.42.42.5(pid=10654): stdout: | (launched: 2022-12-09_20:16:08.298132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:09.865280 run osmo-stp_10.42.42.5(pid=10654): stderr: | 20221209201608512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201608512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201608512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201608512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201608513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201608513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201608513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:10.002008 run osmo-stp_10.42.42.5(pid=10654): stdout: | (launched: 2022-12-09_20:16:08.298132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:10.132935 run osmo-stp_10.42.42.5(pid=10654): stderr: | 20221209201608512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201608512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201608512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201608512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201608513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201608513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201608513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:10.290019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10654): Process ended prematurely: osmo-stp_10.42.42.5(pid=10654) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:16:10.299575 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:16:10.327629 run osmo-hlr_10.42.42.2(pid=10651): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10651)] 20:16:10.377650 run osmo-hlr_10.42.42.2(pid=10651): stdout: | (launched: 2022-12-09_20:16:07.277405) 20:16:10.429425 run osmo-hlr_10.42.42.2(pid=10651): stderr: | 20221209201607475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201607476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201607476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201607476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201607476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201607476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201607489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201607497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201607498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201607498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:10.501250 run osmo-msc_10.42.42.6(pid=10657): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10657)] 20:16:10.551388 run osmo-msc_10.42.42.6(pid=10657): stdout: | (launched: 2022-12-09_20:16:09.345054) 20:16:10.603314 run osmo-msc_10.42.42.6(pid=10657): stderr: | 20221209201609666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201609666 DLGLOBAL DEBUG validating counter group 0x7f9955fa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201609666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201609666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201609666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201609667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201609668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201609669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201609669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201609669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:10.655501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Terminating (SIGTERM) 20:16:10.696683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Terminating (SIGTERM) 20:16:10.737847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Terminating (SIGTERM) 20:16:10.779398 --- ParallelTerminationStrategy: PID 10650 died... 20:16:10.799223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Terminated: ok {rc=0} 20:16:10.845159 --- ParallelTerminationStrategy: PID 10653 died... 20:16:10.864642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Terminated: ok {rc=0} 20:16:10.910529 --- ParallelTerminationStrategy: PID 10656 died... 20:16:10.930194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Terminated: ok {rc=0} 20:16:11.017937 bus /sierra_3: Setting Powered False 20:16:12.116815 bus /sierra_3: Setting Powered False 20:16:13.232741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:16:14.467664 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:14.474522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:16:14.495543 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:16:14.522828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:16:14.576091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:16:14.597241 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:16:14.624502 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:16:15.176522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:16:15.232194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.243554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:16:15.301203 tst mo_mt_call.py: using LAC 23458 20:16:15.431479 tst mo_mt_call.py: using RAC 253 20:16:15.561651 tst mo_mt_call.py: using CellId 23458 20:16:15.695168 tst mo_mt_call.py: using BVCI 23459 20:16:15.815722 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.827360 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.842105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.862136 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.876239 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:15.888134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:16.012911 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:16.140422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:16.638100 run create_hlr_db(pid=10662): Launched 20:16:16.799353 bus /sierra_2: Setting Powered False 20:16:17.864629 run create_hlr_db(pid=10662): Terminated: ok {rc=0} 20:16:18.321715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Launched 20:16:18.650933 run osmo-hlr_10.42.42.2(pid=10665): Launched 20:16:18.775455 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:19.340484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Launched 20:16:19.670283 run osmo-stp_10.42.42.5(pid=10668): Launched 20:16:19.795367 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:20.390606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Launched 20:16:20.719635 run osmo-msc_10.42.42.6(pid=10671): Launched 20:16:20.902838 run osmo-stp_10.42.42.5(pid=10668): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] 20:16:21.040570 run osmo-stp_10.42.42.5(pid=10668): stdout: | (launched: 2022-12-09_20:16:19.609515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:21.178839 run osmo-stp_10.42.42.5(pid=10668): stderr: | 20221209201619802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201619802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201619802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201619803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201619803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201619803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201619803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:21.315856 run osmo-stp_10.42.42.5(pid=10668): stdout: | (launched: 2022-12-09_20:16:19.609515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:21.447054 run osmo-stp_10.42.42.5(pid=10668): stderr: | 20221209201619802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201619802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201619802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201619803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201619803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201619803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201619803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:21.604033 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10668): Process ended prematurely: osmo-stp_10.42.42.5(pid=10668) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:16:21.613651 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:16:21.641738 run osmo-hlr_10.42.42.2(pid=10665): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10665)] 20:16:21.691668 run osmo-hlr_10.42.42.2(pid=10665): stdout: | (launched: 2022-12-09_20:16:18.590458) 20:16:21.743259 run osmo-hlr_10.42.42.2(pid=10665): stderr: | 20221209201618791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201618791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201618791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201618791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201618791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201618791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201618803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201618812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201618812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201618812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:21.815253 run osmo-msc_10.42.42.6(pid=10671): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10671)] 20:16:21.865434 run osmo-msc_10.42.42.6(pid=10671): stdout: | (launched: 2022-12-09_20:16:20.659551) 20:16:21.917381 run osmo-msc_10.42.42.6(pid=10671): stderr: | 20221209201620983 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201620983 DLGLOBAL DEBUG validating counter group 0x7f07317fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201620983 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201620983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201620983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201620983 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201620985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201620986 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201620986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201620986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:21.969067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Terminating (SIGTERM) 20:16:22.010191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Terminating (SIGTERM) 20:16:22.051282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Terminating (SIGTERM) 20:16:22.092772 --- ParallelTerminationStrategy: PID 10664 died... 20:16:22.112678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Terminated: ok {rc=0} 20:16:22.158672 --- ParallelTerminationStrategy: PID 10667 died... 20:16:22.178087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Terminated: ok {rc=0} 20:16:22.223461 --- ParallelTerminationStrategy: PID 10670 died... 20:16:22.242931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Terminated: ok {rc=0} 20:16:22.329782 bus /sierra_3: Setting Powered False 20:16:23.428834 bus /sierra_3: Setting Powered False 20:16:24.545333 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:16:25.692770 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:25.704398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:16:25.763937 tst mo_mt_call_osmux.py: using LAC 23459 20:16:25.887218 tst mo_mt_call_osmux.py: using RAC 254 20:16:26.005992 tst mo_mt_call_osmux.py: using CellId 23459 20:16:26.127594 tst mo_mt_call_osmux.py: using BVCI 23460 20:16:26.249698 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:26.261269 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:26.272485 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:26.283857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:26.295110 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:16:26.306383 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:26.429282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:16:26.552866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:27.029238 run create_hlr_db(pid=10673): Launched 20:16:27.147669 bus /sierra_2: Setting Powered False 20:16:28.209676 run create_hlr_db(pid=10673): Terminated: ok {rc=0} 20:16:28.636419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Launched 20:16:28.943547 run osmo-hlr_10.42.42.2(pid=10676): Launched 20:16:29.061906 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:29.602896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Launched 20:16:29.909522 run osmo-stp_10.42.42.5(pid=10679): Launched 20:16:30.027104 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:30.581976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Launched 20:16:30.914703 run osmo-msc_10.42.42.6(pid=10682): Launched 20:16:31.371558 run osmo-stp_10.42.42.5(pid=10679): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] 20:16:31.513405 run osmo-stp_10.42.42.5(pid=10679): stdout: | (launched: 2022-12-09_20:16:29.853140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:31.655222 run osmo-stp_10.42.42.5(pid=10679): stderr: | 20221209201630024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201630024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201630025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201630025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201630025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201630025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201630026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:31.799110 run osmo-stp_10.42.42.5(pid=10679): stdout: | (launched: 2022-12-09_20:16:29.853140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:31.934333 run osmo-stp_10.42.42.5(pid=10679): stderr: | 20221209201630024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201630024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201630025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201630025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201630025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201630025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201630026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:32.094815 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10679): Process ended prematurely: osmo-stp_10.42.42.5(pid=10679) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:16:32.105738 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:16:32.136190 run osmo-hlr_10.42.42.2(pid=10676): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10676)] 20:16:32.187415 run osmo-hlr_10.42.42.2(pid=10676): stdout: | (launched: 2022-12-09_20:16:28.886973) 20:16:32.241536 run osmo-hlr_10.42.42.2(pid=10676): stderr: | 20221209201629061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201629061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201629061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201629061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201629061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201629061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201629072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201629080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201629080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201629080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:32.315396 run osmo-msc_10.42.42.6(pid=10682): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10682)] 20:16:32.366002 run osmo-msc_10.42.42.6(pid=10682): stdout: | (launched: 2022-12-09_20:16:30.832012) 20:16:32.417946 run osmo-msc_10.42.42.6(pid=10682): stderr: | 20221209201631198 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201631198 DLGLOBAL DEBUG validating counter group 0x7fe21f967c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201631198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201631198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201631198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201631199 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201631200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201631203 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201631204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201631204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:32.470160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Terminating (SIGTERM) 20:16:32.511600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Terminating (SIGTERM) 20:16:32.553358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Terminating (SIGTERM) 20:16:32.595600 --- ParallelTerminationStrategy: PID 10675 died... 20:16:32.615623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Terminated: ok {rc=0} 20:16:32.661778 --- ParallelTerminationStrategy: PID 10678 died... 20:16:32.681612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Terminated: ok {rc=0} 20:16:32.727885 --- ParallelTerminationStrategy: PID 10681 died... 20:16:32.747438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Terminated: ok {rc=0} 20:16:32.834721 bus /sierra_3: Setting Powered False 20:16:33.934011 bus /sierra_3: Setting Powered False 20:16:35.050879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:16:36.284025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:36.290747 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:16:36.311967 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:16:36.338776 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:16:36.391710 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:16:36.412349 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:16:36.439280 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:16:36.987051 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:16:37.036861 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.047892 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:16:37.104366 tst mo_mt_call.py: using LAC 23460 20:16:37.229364 tst mo_mt_call.py: using RAC 255 20:16:37.349298 tst mo_mt_call.py: using CellId 23460 20:16:37.471832 tst mo_mt_call.py: using BVCI 23461 20:16:37.583249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.594434 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.605210 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.616262 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.627428 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:37.638549 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:37.758162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:37.877677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:38.353307 run create_hlr_db(pid=10687): Launched 20:16:38.470088 bus /sierra_2: Setting Powered False 20:16:39.531722 run create_hlr_db(pid=10687): Terminated: ok {rc=0} 20:16:39.981601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10689): Launched 20:16:40.311770 run osmo-hlr_10.42.42.2(pid=10690): Launched 20:16:40.438709 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:41.006863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10692): Launched 20:16:41.335203 run osmo-stp_10.42.42.5(pid=10693): Launched 20:16:41.454404 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:42.010907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10695): Launched 20:16:42.319128 run osmo-msc_10.42.42.6(pid=10696): Launched 20:16:42.490705 run osmo-stp_10.42.42.5(pid=10693): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10693)] 20:16:42.620282 run osmo-stp_10.42.42.5(pid=10693): stdout: | (launched: 2022-12-09_20:16:41.275198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:42.750072 run osmo-stp_10.42.42.5(pid=10693): stderr: | 20221209201641448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201641448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201641448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201641449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201641449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201641449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201641449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:42.877200 run osmo-stp_10.42.42.5(pid=10693): stdout: | (launched: 2022-12-09_20:16:41.275198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:42.999672 run osmo-stp_10.42.42.5(pid=10693): stderr: | 20221209201641448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201641448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201641448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201641449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201641449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201641449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201641449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:43.146023 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10693): Process ended prematurely: osmo-stp_10.42.42.5(pid=10693) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10693)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:16:43.154900 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:16:43.181897 run osmo-hlr_10.42.42.2(pid=10690): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10690)] 20:16:43.229379 run osmo-hlr_10.42.42.2(pid=10690): stdout: | (launched: 2022-12-09_20:16:40.251633) 20:16:43.278689 run osmo-hlr_10.42.42.2(pid=10690): stderr: | 20221209201640454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201640454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201640454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201640454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201640454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201640454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201640467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201640475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201640476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201640476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:43.347397 run osmo-msc_10.42.42.6(pid=10696): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10696)] 20:16:43.395056 run osmo-msc_10.42.42.6(pid=10696): stdout: | (launched: 2022-12-09_20:16:42.262246) 20:16:43.444137 run osmo-msc_10.42.42.6(pid=10696): stderr: | 20221209201642533 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201642533 DLGLOBAL DEBUG validating counter group 0x7efe443f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201642534 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201642534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201642534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201642534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201642536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201642536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201642536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201642536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:43.493717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10689): Terminating (SIGTERM) 20:16:43.533103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10692): Terminating (SIGTERM) 20:16:43.572457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10695): Terminating (SIGTERM) 20:16:43.612230 --- ParallelTerminationStrategy: PID 10689 died... 20:16:43.631104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10689): Terminated: ok {rc=0} 20:16:43.675094 --- ParallelTerminationStrategy: PID 10692 died... 20:16:43.693550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10692): Terminated: ok {rc=0} 20:16:43.737312 --- ParallelTerminationStrategy: PID 10695 died... 20:16:43.755688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10695): Terminated: ok {rc=0} 20:16:43.840709 bus /sierra_3: Setting Powered False 20:16:44.939070 bus /sierra_3: Setting Powered False 20:16:46.068350 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:16:47.242805 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.255576 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:16:47.311418 tst mo_mt_call_osmux.py: using LAC 23461 20:16:47.433543 tst mo_mt_call_osmux.py: using RAC 1 20:16:47.564178 tst mo_mt_call_osmux.py: using CellId 23461 20:16:47.693845 tst mo_mt_call_osmux.py: using BVCI 23462 20:16:47.815559 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.827277 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.838755 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.850370 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.861994 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:16:47.873451 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:47.990908 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:16:48.111169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:48.625847 run create_hlr_db(pid=10698): Launched 20:16:48.759637 bus /sierra_2: Setting Powered False 20:16:49.825954 run create_hlr_db(pid=10698): Terminated: ok {rc=0} 20:16:50.267364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Launched 20:16:50.575810 run osmo-hlr_10.42.42.2(pid=10701): Launched 20:16:50.692871 run osmo-stp_10.42.42.5: Starting osmo-stp 20:16:51.238333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Launched 20:16:51.544822 run osmo-stp_10.42.42.5(pid=10704): Launched 20:16:51.661443 run osmo-msc_10.42.42.6: Starting osmo-msc 20:16:52.216733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10706): Launched 20:16:52.524929 run osmo-msc_10.42.42.6(pid=10707): Launched 20:16:52.697128 run osmo-stp_10.42.42.5(pid=10704): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] 20:16:52.827515 run osmo-stp_10.42.42.5(pid=10704): stdout: | (launched: 2022-12-09_20:16:51.487880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:52.957294 run osmo-stp_10.42.42.5(pid=10704): stderr: | 20221209201651660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201651660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201651660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201651661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201651661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201651661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201651661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:53.084882 run osmo-stp_10.42.42.5(pid=10704): stdout: | (launched: 2022-12-09_20:16:51.487880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:16:53.207839 run osmo-stp_10.42.42.5(pid=10704): stderr: | 20221209201651660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201651660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201651660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201651661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201651661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201651661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201651661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:16:53.354496 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10704): Process ended prematurely: osmo-stp_10.42.42.5(pid=10704) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:16:53.363644 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:16:53.390920 run osmo-hlr_10.42.42.2(pid=10701): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10701)] 20:16:53.438860 run osmo-hlr_10.42.42.2(pid=10701): stdout: | (launched: 2022-12-09_20:16:50.519009) 20:16:53.488398 run osmo-hlr_10.42.42.2(pid=10701): stderr: | 20221209201650697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201650697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201650697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201650697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201650697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201650697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201650709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201650718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201650718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201650718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:16:53.557511 run osmo-msc_10.42.42.6(pid=10707): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10707)] 20:16:53.605379 run osmo-msc_10.42.42.6(pid=10707): stdout: | (launched: 2022-12-09_20:16:52.467652) 20:16:53.655599 run osmo-msc_10.42.42.6(pid=10707): stderr: | 20221209201652741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201652742 DLGLOBAL DEBUG validating counter group 0x7f0335601c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201652742 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201652742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201652742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201652742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201652744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201652744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201652744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201652744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:16:53.706242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Terminating (SIGTERM) 20:16:53.746047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Terminating (SIGTERM) 20:16:53.785995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10706): Terminating (SIGTERM) 20:16:53.826115 --- ParallelTerminationStrategy: PID 10700 died... 20:16:53.845196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10700): Terminated: ok {rc=0} 20:16:53.889622 --- ParallelTerminationStrategy: PID 10703 died... 20:16:53.908015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10703): Terminated: ok {rc=0} 20:16:53.952494 --- ParallelTerminationStrategy: PID 10706 died... 20:16:53.971112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10706): Terminated: ok {rc=0} 20:16:54.057744 bus /sierra_3: Setting Powered False 20:16:55.157082 bus /sierra_3: Setting Powered False 20:16:56.272755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:16:57.504835 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:16:57.511247 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:16:57.532004 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:16:57.559102 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:16:57.611425 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:16:57.632884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:16:57.659698 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:16:58.212559 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:16:58.266104 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.277761 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:16:58.334805 tst mo_mt_call.py: using LAC 23462 20:16:58.464620 tst mo_mt_call.py: using RAC 2 20:16:58.593939 tst mo_mt_call.py: using CellId 23462 20:16:58.724162 tst mo_mt_call.py: using BVCI 23463 20:16:58.843704 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.855495 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.867045 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.878730 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.890482 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:16:58.902278 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:59.019304 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:16:59.138525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:16:59.652045 run create_hlr_db(pid=10712): Launched 20:16:59.785113 bus /sierra_2: Setting Powered False 20:17:00.856521 run create_hlr_db(pid=10712): Terminated: ok {rc=0} 20:17:01.424177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Launched 20:17:01.778135 run osmo-hlr_10.42.42.2(pid=10732): Launched 20:17:01.946713 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:02.654935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Launched 20:17:02.964461 run osmo-stp_10.42.42.5(pid=10735): Launched 20:17:03.082007 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:03.638628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Launched 20:17:03.946628 run osmo-msc_10.42.42.6(pid=10738): Launched 20:17:04.118201 run osmo-stp_10.42.42.5(pid=10735): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] 20:17:04.247330 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-09_20:17:02.907172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:04.376812 run osmo-stp_10.42.42.5(pid=10735): stderr: | 20221209201703078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201703078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201703078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201703079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201703079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201703079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201703079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:04.505210 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-09_20:17:02.907172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:04.627984 run osmo-stp_10.42.42.5(pid=10735): stderr: | 20221209201703078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201703078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201703078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201703079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201703079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201703079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201703079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:04.775105 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:17:04.784007 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:17:04.811365 run osmo-hlr_10.42.42.2(pid=10732): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10732)] 20:17:04.859669 run osmo-hlr_10.42.42.2(pid=10732): stdout: | (launched: 2022-12-09_20:17:01.715268) 20:17:04.909579 run osmo-hlr_10.42.42.2(pid=10732): stderr: | 20221209201702110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201702110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201702110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201702110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201702110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201702110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201702138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201702166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201702166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201702166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:04.978924 run osmo-msc_10.42.42.6(pid=10738): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10738)] 20:17:05.026923 run osmo-msc_10.42.42.6(pid=10738): stdout: | (launched: 2022-12-09_20:17:03.889829) 20:17:05.076366 run osmo-msc_10.42.42.6(pid=10738): stderr: | 20221209201704162 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201704162 DLGLOBAL DEBUG validating counter group 0x7f3bbdcfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201704162 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201704162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201704162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201704163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201704164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201704165 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201704165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201704165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:05.126337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminating (SIGTERM) 20:17:05.166097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminating (SIGTERM) 20:17:05.206142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Terminating (SIGTERM) 20:17:05.246345 --- ParallelTerminationStrategy: PID 10731 died... 20:17:05.265595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminated: ok {rc=0} 20:17:05.310080 --- ParallelTerminationStrategy: PID 10734 died... 20:17:05.328597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminated: ok {rc=0} 20:17:05.372729 --- ParallelTerminationStrategy: PID 10737 died... 20:17:05.391368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10737): Terminated: ok {rc=0} 20:17:05.477054 bus /sierra_3: Setting Powered False 20:17:06.576450 bus /sierra_3: Setting Powered False 20:17:07.693238 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:17:08.846875 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:08.859149 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:17:08.917493 tst mo_mt_call_osmux.py: using LAC 23463 20:17:09.048522 tst mo_mt_call_osmux.py: using RAC 3 20:17:09.177738 tst mo_mt_call_osmux.py: using CellId 23463 20:17:09.299453 tst mo_mt_call_osmux.py: using BVCI 23464 20:17:09.413074 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:09.424087 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:09.435194 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:09.446395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:09.457603 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:17:09.468579 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:09.587902 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:17:09.704749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:10.184213 run create_hlr_db(pid=10740): Launched 20:17:10.300813 bus /sierra_2: Setting Powered False 20:17:11.361961 run create_hlr_db(pid=10740): Terminated: ok {rc=0} 20:17:11.811990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Launched 20:17:12.141948 run osmo-hlr_10.42.42.2(pid=10743): Launched 20:17:12.267654 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:12.839381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Launched 20:17:13.168640 run osmo-stp_10.42.42.5(pid=10746): Launched 20:17:13.294226 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:13.889269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Launched 20:17:14.218181 run osmo-msc_10.42.42.6(pid=10749): Launched 20:17:14.401249 run osmo-stp_10.42.42.5(pid=10746): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] 20:17:14.538514 run osmo-stp_10.42.42.5(pid=10746): stdout: | (launched: 2022-12-09_20:17:13.108242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:14.677233 run osmo-stp_10.42.42.5(pid=10746): stderr: | 20221209201713302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201713302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201713302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201713302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201713303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201713303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201713303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:14.815618 run osmo-stp_10.42.42.5(pid=10746): stdout: | (launched: 2022-12-09_20:17:13.108242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:14.946667 run osmo-stp_10.42.42.5(pid=10746): stderr: | 20221209201713302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201713302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201713302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201713302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201713303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201713303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201713303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:15.103292 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10746): Process ended prematurely: osmo-stp_10.42.42.5(pid=10746) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:17:15.113047 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:17:15.141494 run osmo-hlr_10.42.42.2(pid=10743): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10743)] 20:17:15.191976 run osmo-hlr_10.42.42.2(pid=10743): stdout: | (launched: 2022-12-09_20:17:12.081620) 20:17:15.243917 run osmo-hlr_10.42.42.2(pid=10743): stderr: | 20221209201712281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201712281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201712281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201712281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201712281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201712281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201712293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201712301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201712302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201712302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:15.316563 run osmo-msc_10.42.42.6(pid=10749): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10749)] 20:17:15.366797 run osmo-msc_10.42.42.6(pid=10749): stdout: | (launched: 2022-12-09_20:17:14.157826) 20:17:15.418281 run osmo-msc_10.42.42.6(pid=10749): stderr: | 20221209201714480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201714480 DLGLOBAL DEBUG validating counter group 0x7f80973acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201714481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201714481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201714481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201714481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201714483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201714483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201714483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201714483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:15.470130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Terminating (SIGTERM) 20:17:15.511993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Terminating (SIGTERM) 20:17:15.553804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Terminating (SIGTERM) 20:17:15.596323 --- ParallelTerminationStrategy: PID 10742 died... 20:17:15.616489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10742): Terminated: ok {rc=0} 20:17:15.663336 --- ParallelTerminationStrategy: PID 10745 died... 20:17:15.683082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10745): Terminated: ok {rc=0} 20:17:15.729517 --- ParallelTerminationStrategy: PID 10748 died... 20:17:15.749230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10748): Terminated: ok {rc=0} 20:17:15.837163 bus /sierra_3: Setting Powered False 20:17:16.938253 bus /sierra_3: Setting Powered False 20:17:18.052822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:17:19.299194 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:19.306368 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:17:19.327729 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:17:19.355294 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:17:19.406642 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:17:19.427704 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:17:19.455296 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:17:20.009299 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:17:20.062393 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.074088 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:20.130183 tst mo_mt_call.py: using LAC 23464 20:17:20.251344 tst mo_mt_call.py: using RAC 4 20:17:20.371659 tst mo_mt_call.py: using CellId 23464 20:17:20.490538 tst mo_mt_call.py: using BVCI 23465 20:17:20.603810 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.614927 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.625917 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.637327 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.648392 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:20.659640 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:20.778049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:20.898904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:21.410914 run create_hlr_db(pid=10754): Launched 20:17:21.545600 bus /sierra_2: Setting Powered False 20:17:22.611306 run create_hlr_db(pid=10754): Terminated: ok {rc=0} 20:17:23.070091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Launched 20:17:23.399450 run osmo-hlr_10.42.42.2(pid=10757): Launched 20:17:23.524820 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:24.091282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Launched 20:17:24.420494 run osmo-stp_10.42.42.5(pid=10760): Launched 20:17:24.545722 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:25.142618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Launched 20:17:25.471756 run osmo-msc_10.42.42.6(pid=10763): Launched 20:17:25.655437 run osmo-stp_10.42.42.5(pid=10760): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] 20:17:25.793274 run osmo-stp_10.42.42.5(pid=10760): stdout: | (launched: 2022-12-09_20:17:24.360138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:25.931490 run osmo-stp_10.42.42.5(pid=10760): stderr: | 20221209201724555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201724555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201724555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201724555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201724556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201724556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201724556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:26.069130 run osmo-stp_10.42.42.5(pid=10760): stdout: | (launched: 2022-12-09_20:17:24.360138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:26.200747 run osmo-stp_10.42.42.5(pid=10760): stderr: | 20221209201724555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201724555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201724555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201724555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201724556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201724556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201724556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:26.357705 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10760): Process ended prematurely: osmo-stp_10.42.42.5(pid=10760) [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:17:26.367607 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:17:26.395948 run osmo-hlr_10.42.42.2(pid=10757): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10757)] 20:17:26.446337 run osmo-hlr_10.42.42.2(pid=10757): stdout: | (launched: 2022-12-09_20:17:23.339329) 20:17:26.498550 run osmo-hlr_10.42.42.2(pid=10757): stderr: | 20221209201723542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201723542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201723542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201723543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201723543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201723543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201723558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201723568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201723568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201723568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:26.571227 run osmo-msc_10.42.42.6(pid=10763): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10763)] 20:17:26.621915 run osmo-msc_10.42.42.6(pid=10763): stdout: | (launched: 2022-12-09_20:17:25.411559) 20:17:26.673809 run osmo-msc_10.42.42.6(pid=10763): stderr: | 20221209201725734 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201725734 DLGLOBAL DEBUG validating counter group 0x7fb8bc399c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201725734 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201725734 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201725735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201725735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201725737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201725737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201725737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201725737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:26.725921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Terminating (SIGTERM) 20:17:26.767972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Terminating (SIGTERM) 20:17:26.810559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Terminating (SIGTERM) 20:17:26.853266 --- ParallelTerminationStrategy: PID 10756 died... 20:17:26.873417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10756): Terminated: ok {rc=0} 20:17:26.920296 --- ParallelTerminationStrategy: PID 10759 died... 20:17:26.940086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10759): Terminated: ok {rc=0} 20:17:26.986845 --- ParallelTerminationStrategy: PID 10762 died... 20:17:27.006538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10762): Terminated: ok {rc=0} 20:17:27.093556 bus /sierra_3: Setting Powered False 20:17:28.192054 bus /sierra_3: Setting Powered False 20:17:29.308933 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:17:30.458831 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:30.471097 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:17:30.529986 tst mo_mt_call_osmux.py: using LAC 23465 20:17:30.654488 tst mo_mt_call_osmux.py: using RAC 5 20:17:30.777391 tst mo_mt_call_osmux.py: using CellId 23465 20:17:30.922633 tst mo_mt_call_osmux.py: using BVCI 23466 20:17:31.037309 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:31.048845 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:31.060384 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:31.072721 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:31.085405 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:17:31.097700 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:31.212836 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:17:31.368354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:31.899294 run create_hlr_db(pid=10765): Launched 20:17:32.068600 bus /sierra_2: Setting Powered False 20:17:33.130460 run create_hlr_db(pid=10765): Terminated: ok {rc=0} 20:17:33.570761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Launched 20:17:33.878168 run osmo-hlr_10.42.42.2(pid=10768): Launched 20:17:33.994742 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:34.526521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Launched 20:17:34.834389 run osmo-stp_10.42.42.5(pid=10771): Launched 20:17:34.951239 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:35.505779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Launched 20:17:35.812880 run osmo-msc_10.42.42.6(pid=10774): Launched 20:17:35.989613 run osmo-stp_10.42.42.5(pid=10771): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] 20:17:36.119632 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-09_20:17:34.777263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:36.249262 run osmo-stp_10.42.42.5(pid=10771): stderr: | 20221209201734950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201734950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201734950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201734950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201734951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201734951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201734951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:36.377213 run osmo-stp_10.42.42.5(pid=10771): stdout: | (launched: 2022-12-09_20:17:34.777263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:36.499903 run osmo-stp_10.42.42.5(pid=10771): stderr: | 20221209201734950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201734950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201734950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201734950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201734951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201734951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201734951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:36.647299 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:17:36.656246 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:17:36.683345 run osmo-hlr_10.42.42.2(pid=10768): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10768)] 20:17:36.731313 run osmo-hlr_10.42.42.2(pid=10768): stdout: | (launched: 2022-12-09_20:17:33.821364) 20:17:36.781080 run osmo-hlr_10.42.42.2(pid=10768): stderr: | 20221209201734000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201734000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201734000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201734000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201734000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201734000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201734013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201734022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201734022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201734022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:36.850700 run osmo-msc_10.42.42.6(pid=10774): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10774)] 20:17:36.898947 run osmo-msc_10.42.42.6(pid=10774): stdout: | (launched: 2022-12-09_20:17:35.756114) 20:17:36.948207 run osmo-msc_10.42.42.6(pid=10774): stderr: | 20221209201736034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201736035 DLGLOBAL DEBUG validating counter group 0x7f7d80a9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201736035 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201736035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201736035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201736035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201736037 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201736037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201736038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201736038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:36.997825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminating (SIGTERM) 20:17:37.037561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminating (SIGTERM) 20:17:37.077461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Terminating (SIGTERM) 20:17:37.117628 --- ParallelTerminationStrategy: PID 10767 died... 20:17:37.136804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10767): Terminated: ok {rc=0} 20:17:37.181166 --- ParallelTerminationStrategy: PID 10770 died... 20:17:37.199738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10770): Terminated: ok {rc=0} 20:17:37.243871 --- ParallelTerminationStrategy: PID 10773 died... 20:17:37.262420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10773): Terminated: ok {rc=0} 20:17:37.349044 bus /sierra_3: Setting Powered False 20:17:38.448294 bus /sierra_3: Setting Powered False 20:17:39.560556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:17:40.796237 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:17:40.801824 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:17:40.823065 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:17:40.849450 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:17:40.901710 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:17:40.926467 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:17:40.953853 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:17:41.496783 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:17:41.547140 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:41.557900 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:17:41.614916 tst mo_mt_call.py: using LAC 23466 20:17:41.736132 tst mo_mt_call.py: using RAC 6 20:17:41.858111 tst mo_mt_call.py: using CellId 23466 20:17:41.978613 tst mo_mt_call.py: using BVCI 23467 20:17:42.089698 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:42.100440 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:42.111061 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:42.122084 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:42.133044 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:42.144235 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:42.264628 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:42.385627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:42.897447 run create_hlr_db(pid=10781): Launched 20:17:43.031341 bus /sierra_2: Setting Powered False 20:17:44.096145 run create_hlr_db(pid=10781): Terminated: ok {rc=0} 20:17:44.534056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10783): Launched 20:17:44.841499 run osmo-hlr_10.42.42.2(pid=10784): Launched 20:17:44.959550 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:45.492527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10786): Launched 20:17:45.800441 run osmo-stp_10.42.42.5(pid=10787): Launched 20:17:45.988532 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:46.764464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10789): Launched 20:17:47.178627 run osmo-msc_10.42.42.6(pid=10790): Launched 20:17:47.443186 run osmo-stp_10.42.42.5(pid=10787): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10787)] 20:17:47.583386 run osmo-stp_10.42.42.5(pid=10787): stdout: | (launched: 2022-12-09_20:17:45.743616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:47.716201 run osmo-stp_10.42.42.5(pid=10787): stderr: | 20221209201746042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201746042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201746043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201746043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201746044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201746044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201746044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:47.844329 run osmo-stp_10.42.42.5(pid=10787): stdout: | (launched: 2022-12-09_20:17:45.743616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:47.967119 run osmo-stp_10.42.42.5(pid=10787): stderr: | 20221209201746042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201746042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201746043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201746043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201746044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201746044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201746044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:48.114178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10787): Process ended prematurely: osmo-stp_10.42.42.5(pid=10787) [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10787)] [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:17:48.123093 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:17:48.150599 run osmo-hlr_10.42.42.2(pid=10784): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10784)] 20:17:48.199064 run osmo-hlr_10.42.42.2(pid=10784): stdout: | (launched: 2022-12-09_20:17:44.784817) 20:17:48.249310 run osmo-hlr_10.42.42.2(pid=10784): stderr: | 20221209201744964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201744964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201744964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201744964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201744965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201744965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201744976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201744985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201744985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201744985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:48.319240 run osmo-msc_10.42.42.6(pid=10790): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10790)] 20:17:48.367553 run osmo-msc_10.42.42.6(pid=10790): stdout: | (launched: 2022-12-09_20:17:47.100494) 20:17:48.417819 run osmo-msc_10.42.42.6(pid=10790): stderr: | 20221209201747572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201747572 DLGLOBAL DEBUG validating counter group 0x7f8c6160ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201747572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201747572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201747572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201747573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201747574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201747575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201747575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201747575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:48.468113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10783): Terminating (SIGTERM) 20:17:48.508449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10786): Terminating (SIGTERM) 20:17:48.548425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10789): Terminating (SIGTERM) 20:17:48.588444 --- ParallelTerminationStrategy: PID 10783 died... 20:17:48.607822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10783): Terminated: ok {rc=0} 20:17:48.653141 --- ParallelTerminationStrategy: PID 10786 died... 20:17:48.672037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10786): Terminated: ok {rc=0} 20:17:48.716678 --- ParallelTerminationStrategy: PID 10789 died... 20:17:48.735720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10789): Terminated: ok {rc=0} 20:17:48.820870 bus /sierra_3: Setting Powered False 20:17:49.919705 bus /sierra_3: Setting Powered False 20:17:51.038810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:17:52.190862 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.202917 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:17:52.265795 tst mo_mt_call_osmux.py: using LAC 23467 20:17:52.387067 tst mo_mt_call_osmux.py: using RAC 7 20:17:52.505896 tst mo_mt_call_osmux.py: using CellId 23467 20:17:52.624293 tst mo_mt_call_osmux.py: using BVCI 23468 20:17:52.735533 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.746791 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.757434 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.768276 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.779109 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:17:52.790016 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:52.911363 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:17:53.033993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:17:53.546553 run create_hlr_db(pid=10792): Launched 20:17:53.681000 bus /sierra_2: Setting Powered False 20:17:54.746491 run create_hlr_db(pid=10792): Terminated: ok {rc=0} 20:17:55.186299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10794): Launched 20:17:55.495505 run osmo-hlr_10.42.42.2(pid=10795): Launched 20:17:55.613494 run osmo-stp_10.42.42.5: Starting osmo-stp 20:17:56.158526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10797): Launched 20:17:56.464937 run osmo-stp_10.42.42.5(pid=10798): Launched 20:17:56.582524 run osmo-msc_10.42.42.6: Starting osmo-msc 20:17:57.142831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10800): Launched 20:17:57.451579 run osmo-msc_10.42.42.6(pid=10801): Launched 20:17:57.625159 run osmo-stp_10.42.42.5(pid=10798): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10798)] 20:17:57.754816 run osmo-stp_10.42.42.5(pid=10798): stdout: | (launched: 2022-12-09_20:17:56.408323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:57.884590 run osmo-stp_10.42.42.5(pid=10798): stderr: | 20221209201756580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201756580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201756580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201756580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201756581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201756581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201756581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:58.012253 run osmo-stp_10.42.42.5(pid=10798): stdout: | (launched: 2022-12-09_20:17:56.408323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:17:58.134843 run osmo-stp_10.42.42.5(pid=10798): stderr: | 20221209201756580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201756580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201756580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201756580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201756581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201756581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201756581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:17:58.281624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10798): Process ended prematurely: osmo-stp_10.42.42.5(pid=10798) [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10798)] [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:17:58.290643 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:17:58.317561 run osmo-hlr_10.42.42.2(pid=10795): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10795)] 20:17:58.365403 run osmo-hlr_10.42.42.2(pid=10795): stdout: | (launched: 2022-12-09_20:17:55.438408) 20:17:58.414757 run osmo-hlr_10.42.42.2(pid=10795): stderr: | 20221209201755615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201755615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201755615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201755615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201755615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201755615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201755627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201755638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201755638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201755638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:17:58.483204 run osmo-msc_10.42.42.6(pid=10801): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10801)] 20:17:58.530722 run osmo-msc_10.42.42.6(pid=10801): stdout: | (launched: 2022-12-09_20:17:57.394442) 20:17:58.580181 run osmo-msc_10.42.42.6(pid=10801): stderr: | 20221209201757666 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201757666 DLGLOBAL DEBUG validating counter group 0x7f82c0defc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201757666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201757666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201757667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201757667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201757669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201757669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201757669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201757669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:17:58.629942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10794): Terminating (SIGTERM) 20:17:58.669312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10797): Terminating (SIGTERM) 20:17:58.708648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10800): Terminating (SIGTERM) 20:17:58.748305 --- ParallelTerminationStrategy: PID 10794 died... 20:17:58.767216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10794): Terminated: ok {rc=0} 20:17:58.810929 --- ParallelTerminationStrategy: PID 10797 died... 20:17:58.829356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10797): Terminated: ok {rc=0} 20:17:58.873269 --- ParallelTerminationStrategy: PID 10800 died... 20:17:58.891426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10800): Terminated: ok {rc=0} 20:17:58.974338 bus /sierra_3: Setting Powered False 20:18:00.071136 bus /sierra_3: Setting Powered False 20:18:01.186185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:oc2g --------------------------------------------------------------------- 20:18:02.436228 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:18:02.441755 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 20:18:02.462997 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 20:18:02.489461 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 20:18:02.573488 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 20:18:02.593778 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 20:18:02.620277 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 20:18:03.202846 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 20:18:03.207705 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.218221 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:18:03.254176 tst emergency_mo_mt_call.py: using LAC 23468 20:18:03.377781 tst emergency_mo_mt_call.py: using RAC 8 20:18:03.505777 tst emergency_mo_mt_call.py: using CellId 23468 20:18:03.635049 tst emergency_mo_mt_call.py: using BVCI 23469 20:18:03.754767 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.765939 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.777017 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.787892 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.798727 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:03.809546 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:03.924753 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:04.043966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:04.547643 run create_hlr_db(pid=10806): Launched 20:18:04.679283 bus /sierra_2: Setting Powered False 20:18:05.744353 run create_hlr_db(pid=10806): Terminated: ok {rc=0} 20:18:06.177683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10808): Launched 20:18:06.480161 run osmo-hlr_10.42.42.2(pid=10809): Launched 20:18:06.595952 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:07.129880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10811): Launched 20:18:07.430204 run osmo-stp_10.42.42.5(pid=10812): Launched 20:18:07.553030 tst emergency_mo_mt_call.py: using MSISDN 7364 20:18:07.706614 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:08.246884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10814): Launched 20:18:08.547567 run osmo-msc_10.42.42.6(pid=10815): Launched 20:18:08.715451 run osmo-stp_10.42.42.5(pid=10812): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10812)] 20:18:08.861596 run osmo-stp_10.42.42.5(pid=10812): stdout: | (launched: 2022-12-09_20:18:07.374771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:08.999507 run osmo-stp_10.42.42.5(pid=10812): stderr: | 20221209201807544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201807544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201807544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201807546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201807546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201807546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201807546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:09.134120 run osmo-stp_10.42.42.5(pid=10812): stdout: | (launched: 2022-12-09_20:18:07.374771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:09.263712 run osmo-stp_10.42.42.5(pid=10812): stderr: | 20221209201807544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201807544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201807544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201807546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201807546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201807546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201807546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:09.417163 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10812): Process ended prematurely: osmo-stp_10.42.42.5(pid=10812) [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10812)] [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py:19] 20:18:09.426259 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 20:18:09.453750 run osmo-hlr_10.42.42.2(pid=10809): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10809)] 20:18:09.503586 run osmo-hlr_10.42.42.2(pid=10809): stdout: | (launched: 2022-12-09_20:18:06.424138) 20:18:09.554993 run osmo-hlr_10.42.42.2(pid=10809): stderr: | 20221209201806601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201806601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201806601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201806601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201806601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201806601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201806617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201806627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201806628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201806628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:09.626886 run osmo-msc_10.42.42.6(pid=10815): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10815)] 20:18:09.676717 run osmo-msc_10.42.42.6(pid=10815): stdout: | (launched: 2022-12-09_20:18:08.491810) 20:18:09.727858 run osmo-msc_10.42.42.6(pid=10815): stderr: | 20221209201808773 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201808773 DLGLOBAL DEBUG validating counter group 0x7fcfd2249c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201808774 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201808774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201808774 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201808774 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201808776 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201808776 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201808776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201808777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:09.779329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10808): Terminating (SIGTERM) 20:18:09.820678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10811): Terminating (SIGTERM) 20:18:09.862198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10814): Terminating (SIGTERM) 20:18:09.904208 --- ParallelTerminationStrategy: PID 10808 died... 20:18:09.924347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10808): Terminated: ok {rc=0} 20:18:09.970976 --- ParallelTerminationStrategy: PID 10811 died... 20:18:09.990714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10811): Terminated: ok {rc=0} 20:18:10.036806 --- ParallelTerminationStrategy: PID 10814 died... 20:18:10.056773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10814): Terminated: ok {rc=0} 20:18:10.144648 bus /sierra_3: Setting Powered False 20:18:11.245305 bus /sierra_3: Setting Powered False 20:18:12.364555 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 20:18:13.451880 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:13.463647 tst emergency:oc2g: Using 1 x bts (candidates: 1) 20:18:13.502187 tst emergency_preemptive_call.py: using LAC 23469 20:18:13.623193 tst emergency_preemptive_call.py: using RAC 9 20:18:13.743945 tst emergency_preemptive_call.py: using CellId 23469 20:18:13.872452 tst emergency_preemptive_call.py: using BVCI 23470 20:18:13.991955 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:14.003150 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:14.014270 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:14.025922 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:14.037305 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 20:18:14.048612 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:14.169183 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:14.284860 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:14.400332 tst emergency:oc2g: Using 1 x modem (candidates: 4) 20:18:14.517660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:14.991512 run create_hlr_db(pid=10817): Launched 20:18:15.107658 bus /sierra_2: Setting Powered False 20:18:16.183505 run create_hlr_db(pid=10817): Terminated: ok {rc=0} 20:18:16.682937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10819): Launched 20:18:17.016875 run osmo-hlr_10.42.42.2(pid=10820): Launched 20:18:17.168233 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:17.751007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10822): Launched 20:18:18.075891 run osmo-stp_10.42.42.5(pid=10823): Launched 20:18:18.210049 tst emergency_preemptive_call.py: using MSISDN 7365 20:18:18.376174 run osmo-msc_10.42.42.6: Starting osmo-msc 20:18:18.958384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10825): Launched 20:18:19.282495 run osmo-msc_10.42.42.6(pid=10826): Launched 20:18:19.463105 run osmo-stp_10.42.42.5(pid=10823): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10823)] 20:18:19.598633 run osmo-stp_10.42.42.5(pid=10823): stdout: | (launched: 2022-12-09_20:18:18.016311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:19.735445 run osmo-stp_10.42.42.5(pid=10823): stderr: | 20221209201818209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201818209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201818209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201818210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201818210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201818210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201818210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:19.871057 run osmo-stp_10.42.42.5(pid=10823): stdout: | (launched: 2022-12-09_20:18:18.016311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:20.000018 run osmo-stp_10.42.42.5(pid=10823): stderr: | 20221209201818209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201818209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201818209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201818210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201818210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201818210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201818210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:20.154248 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10823): Process ended prematurely: osmo-stp_10.42.42.5(pid=10823) [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10823)] [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py:32] 20:18:20.163452 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 20:18:20.191361 run osmo-hlr_10.42.42.2(pid=10820): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10820)] 20:18:20.241649 run osmo-hlr_10.42.42.2(pid=10820): stdout: | (launched: 2022-12-09_20:18:16.955828) 20:18:20.293579 run osmo-hlr_10.42.42.2(pid=10820): stderr: | 20221209201817272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201817273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201817273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201817273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201817273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201817273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201817285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201817293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201817294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201817294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:20.366467 run osmo-msc_10.42.42.6(pid=10826): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10826)] 20:18:20.416851 run osmo-msc_10.42.42.6(pid=10826): stdout: | (launched: 2022-12-09_20:18:19.222646) 20:18:20.468603 run osmo-msc_10.42.42.6(pid=10826): stderr: | 20221209201819545 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209201819545 DLGLOBAL DEBUG validating counter group 0x7fcf4c9f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209201819545 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209201819545 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209201819545 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209201819546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209201819547 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209201819548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209201819548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209201819548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:18:20.520786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10819): Terminating (SIGTERM) 20:18:20.562619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10822): Terminating (SIGTERM) 20:18:20.604342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10825): Terminating (SIGTERM) 20:18:20.646856 --- ParallelTerminationStrategy: PID 10819 died... 20:18:20.667043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10819): Terminated: ok {rc=0} 20:18:20.713775 --- ParallelTerminationStrategy: PID 10822 died... 20:18:20.733494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10822): Terminated: ok {rc=0} 20:18:20.780039 --- ParallelTerminationStrategy: PID 10825 died... 20:18:20.799717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10825): Terminated: ok {rc=0} 20:18:20.887552 bus /sierra_9: Setting Powered False 20:18:21.986469 bus /sierra_9: Setting Powered False 20:18:23.101679 bus /sierra_8: Setting Powered False 20:18:24.201109 bus /sierra_8: Setting Powered False 20:18:25.315696 bus /sierra_3: Setting Powered False 20:18:26.414569 bus /sierra_3: Setting Powered False 20:18:27.531661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:oc2g --------------------------------------------------------------------- 20:18:28.794872 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:18:28.799425 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 20:18:28.820301 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 20:18:28.859740 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 20:18:28.949153 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 20:18:28.970899 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 20:18:29.010370 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 20:18:29.598993 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 20:18:29.652942 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:29.663895 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:29.699655 tst cs_paging_gprs_active.py: using LAC 23470 20:18:29.829117 tst cs_paging_gprs_active.py: using RAC 10 20:18:29.959594 tst cs_paging_gprs_active.py: using CellId 23470 20:18:30.090357 tst cs_paging_gprs_active.py: using BVCI 23471 20:18:30.210184 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.220916 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.231692 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.242418 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.253158 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.263867 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.274635 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.285370 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:30.296105 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:30.419151 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:30.542329 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:18:30.766011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:31.107926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10831): Launched 20:18:31.402871 run iperf3-srv_10.42.42.10(pid=10832): Launched 20:18:31.535808 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:18:31.750216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:32.074015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10833): Launched 20:18:32.361743 run iperf3-srv_10.42.42.10(pid=10834): Launched 20:18:32.488484 tst cs_paging_gprs_active.py:38: start network... 20:18:32.696333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:33.174128 run create_hlr_db(pid=10835): Launched 20:18:33.292561 bus /sierra_2: Setting Powered False 20:18:34.354555 run create_hlr_db(pid=10835): Terminated: ok {rc=0} 20:18:34.781710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Launched 20:18:35.089923 run osmo-hlr_10.42.42.2(pid=10838): Launched 20:18:35.207472 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:35.753711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Launched 20:18:36.060936 run osmo-stp_10.42.42.5(pid=10841): Launched 20:18:36.177968 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:36.707112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10843): Launched 20:18:36.824011 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:37.084411 run patchelf(pid=10844): Launched 20:18:37.255955 run osmo-stp_10.42.42.5(pid=10841): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] 20:18:37.386438 run osmo-stp_10.42.42.5(pid=10841): stdout: | (launched: 2022-12-09_20:18:36.003940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:37.517907 run osmo-stp_10.42.42.5(pid=10841): stderr: | 20221209201836173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201836173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201836173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201836174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201836174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201836174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201836175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:37.649698 run osmo-stp_10.42.42.5(pid=10841): stdout: | (launched: 2022-12-09_20:18:36.003940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:37.775169 run osmo-stp_10.42.42.5(pid=10841): stderr: | 20221209201836173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201836173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201836173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201836174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201836174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201836174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201836175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:37.924051 run patchelf(pid=10844): Terminating (SIGINT) 20:18:38.097659 run patchelf(pid=10844): Terminated: ok {rc=0} 20:18:38.222115 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10841): Process ended prematurely: osmo-stp_10.42.42.5(pid=10841) [trial-2364↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] [trial-2364↪gprs:oc2g↪cs_paging_gprs_active.py:38] 20:18:38.231708 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:18:38.259579 run osmo-hlr_10.42.42.2(pid=10838): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10838)] 20:18:38.308015 run osmo-hlr_10.42.42.2(pid=10838): stdout: | (launched: 2022-12-09_20:18:35.032668) 20:18:38.357616 run osmo-hlr_10.42.42.2(pid=10838): stderr: | 20221209201835210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201835210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201835210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201835210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201835210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201835210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201835221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201835230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201835230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201835230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:38.407505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10831): Terminating (SIGTERM) 20:18:38.447332 run iperf3-srv_10.42.42.10(pid=10832): Terminating (SIGTERM) 20:18:38.487058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10833): Terminating (SIGTERM) 20:18:38.526863 run iperf3-srv_10.42.42.10(pid=10834): Terminating (SIGTERM) 20:18:38.566472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Terminating (SIGTERM) 20:18:38.606322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Terminating (SIGTERM) 20:18:38.646167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10843): Terminating (SIGTERM) 20:18:38.686286 --- ParallelTerminationStrategy: PID 10831 died... 20:18:38.705276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10831): Terminated: ok {rc=0} 20:18:38.749499 --- ParallelTerminationStrategy: PID 10832 died... 20:18:38.768048 run iperf3-srv_10.42.42.10(pid=10832): Terminated {rc=256} 20:18:38.812174 --- ParallelTerminationStrategy: PID 10833 died... 20:18:38.830834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10833): Terminated: ok {rc=0} 20:18:38.874970 --- ParallelTerminationStrategy: PID 10834 died... 20:18:38.893553 run iperf3-srv_10.42.42.10(pid=10834): Terminated {rc=256} 20:18:38.937409 --- ParallelTerminationStrategy: PID 10837 died... 20:18:38.956128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10837): Terminated: ok {rc=0} 20:18:39.000108 --- ParallelTerminationStrategy: PID 10840 died... 20:18:39.018765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10840): Terminated: ok {rc=0} 20:18:39.062944 --- ParallelTerminationStrategy: PID 10843 died... 20:18:39.081620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10843): Terminated: ok {rc=0} 20:18:39.164219 bus /gobi_0: Setting Powered False 20:18:40.260110 bus /gobi_0: Setting Powered False 20:18:41.375371 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g iperf3.py ---------------------------------------------- 20:18:42.525311 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:42.536818 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:42.573722 tst iperf3.py: using LAC 23471 20:18:42.705216 tst iperf3.py: using RAC 11 20:18:42.826578 tst iperf3.py: using CellId 23471 20:18:42.949316 tst iperf3.py: using BVCI 23472 20:18:43.069677 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.080481 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.091375 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.102167 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.112764 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.123539 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.134364 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.145138 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:43.156031 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:43.279019 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:18:43.503489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:43.834858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10845): Launched 20:18:44.122178 run iperf3-srv_10.42.42.10(pid=10846): Launched 20:18:44.245297 tst iperf3.py:8: start network... 20:18:44.467235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:44.978482 run create_hlr_db(pid=10847): Launched 20:18:45.112219 bus /gobi_6: Setting Powered False 20:18:46.175082 run create_hlr_db(pid=10847): Terminated: ok {rc=0} 20:18:46.642374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Launched 20:18:46.976843 run osmo-hlr_10.42.42.2(pid=10850): Launched 20:18:47.243143 run osmo-stp_10.42.42.5: Starting osmo-stp 20:18:47.810293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Launched 20:18:48.139825 run osmo-stp_10.42.42.5(pid=10853): Launched 20:18:48.266036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:18:48.835658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10855): Launched 20:18:48.961076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:18:49.240202 run patchelf(pid=10856): Launched 20:18:49.423278 run osmo-stp_10.42.42.5(pid=10853): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] 20:18:49.563028 run osmo-stp_10.42.42.5(pid=10853): stdout: | (launched: 2022-12-09_20:18:48.079201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:49.704037 run osmo-stp_10.42.42.5(pid=10853): stderr: | 20221209201848272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201848272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201848272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201848273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201848273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201848273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201848273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:49.844122 run osmo-stp_10.42.42.5(pid=10853): stdout: | (launched: 2022-12-09_20:18:48.079201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:18:49.978723 run osmo-stp_10.42.42.5(pid=10853): stderr: | 20221209201848272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201848272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201848272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201848273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201848273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201848273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201848273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:18:50.138495 run patchelf(pid=10856): Terminating (SIGINT) 20:18:50.323052 run patchelf(pid=10856): Terminated: ok {rc=0} 20:18:50.455966 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10853): Process ended prematurely: osmo-stp_10.42.42.5(pid=10853) [trial-2364↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] [trial-2364↪gprs:oc2g↪iperf3.py:8] 20:18:50.466416 tst iperf3.py:8: Test FAILED (8.0 sec) 20:18:50.495086 run osmo-hlr_10.42.42.2(pid=10850): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10850)] 20:18:50.545122 run osmo-hlr_10.42.42.2(pid=10850): stdout: | (launched: 2022-12-09_20:18:46.913960) 20:18:50.596659 run osmo-hlr_10.42.42.2(pid=10850): stderr: | 20221209201847207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201847207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201847207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201847207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201847207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201847207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201847218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201847227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201847227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201847227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:18:50.648919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10845): Terminating (SIGTERM) 20:18:50.690476 run iperf3-srv_10.42.42.10(pid=10846): Terminating (SIGTERM) 20:18:50.732038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Terminating (SIGTERM) 20:18:50.774009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Terminating (SIGTERM) 20:18:50.815461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10855): Terminating (SIGTERM) 20:18:50.857294 --- ParallelTerminationStrategy: PID 10845 died... 20:18:50.877220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10845): Terminated: ok {rc=0} 20:18:50.923064 --- ParallelTerminationStrategy: PID 10846 died... 20:18:50.942468 run iperf3-srv_10.42.42.10(pid=10846): Terminated {rc=256} 20:18:50.988537 --- ParallelTerminationStrategy: PID 10849 died... 20:18:51.008159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10849): Terminated: ok {rc=0} 20:18:51.054202 --- ParallelTerminationStrategy: PID 10852 died... 20:18:51.073862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10852): Terminated: ok {rc=0} 20:18:51.119947 --- ParallelTerminationStrategy: PID 10855 died... 20:18:51.139491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10855): Terminated: ok {rc=0} 20:18:51.226884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g iperf3m4.py ---------------------------------------------- 20:18:52.378867 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.390394 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:18:52.426739 tst iperf3m4.py: using LAC 23472 20:18:52.557184 tst iperf3m4.py: using RAC 12 20:18:52.686980 tst iperf3m4.py: using CellId 23472 20:18:52.818780 tst iperf3m4.py: using BVCI 23473 20:18:52.940321 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.951394 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.962237 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.973075 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.983733 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:52.994436 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:53.005357 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:53.016049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:18:53.026964 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:53.148860 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:53.269543 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:53.388340 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:18:53.502594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:18:53.710011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:54.020206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Launched 20:18:54.288698 run iperf3-srv_10.42.42.10(pid=10858): Launched 20:18:54.405596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:18:54.613219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:54.922636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Launched 20:18:55.190430 run iperf3-srv_10.42.42.10(pid=10860): Launched 20:18:55.305908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:18:55.512852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:55.822349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10861): Launched 20:18:56.089890 run iperf3-srv_10.42.42.10(pid=10862): Launched 20:18:56.204874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:18:56.410841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:18:56.720080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10863): Launched 20:18:56.988340 run iperf3-srv_10.42.42.10(pid=10864): Launched 20:18:57.103860 tst iperf3m4.py:8: start network... 20:18:57.310549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:18:57.788219 run create_hlr_db(pid=10865): Launched 20:18:57.907296 bus /gobi_6: Setting Powered False 20:18:58.968273 run create_hlr_db(pid=10865): Terminated: ok {rc=0} 20:18:59.396267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Launched 20:18:59.705471 run osmo-hlr_10.42.42.2(pid=10868): Launched 20:18:59.823613 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:00.354708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Launched 20:19:00.661765 run osmo-stp_10.42.42.5(pid=10871): Launched 20:19:00.779443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:01.350397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10873): Launched 20:19:01.478690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:01.747893 run patchelf(pid=10874): Launched 20:19:01.949554 run osmo-stp_10.42.42.5(pid=10871): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] 20:19:02.092832 run osmo-stp_10.42.42.5(pid=10871): stdout: | (launched: 2022-12-09_20:19:00.605103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:02.237246 run osmo-stp_10.42.42.5(pid=10871): stderr: | 20221209201900774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201900774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201900774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201900775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201900775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201900775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201900775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:02.378727 run osmo-stp_10.42.42.5(pid=10871): stdout: | (launched: 2022-12-09_20:19:00.605103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:02.514420 run osmo-stp_10.42.42.5(pid=10871): stderr: | 20221209201900774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201900774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201900774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201900775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201900775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201900775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201900775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:02.675824 run patchelf(pid=10874): Terminating (SIGINT) 20:19:02.860741 run patchelf(pid=10874): Terminated: ok {rc=0} 20:19:02.994212 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10871): Process ended prematurely: osmo-stp_10.42.42.5(pid=10871) [trial-2364↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] [trial-2364↪gprs:oc2g↪iperf3m4.py:8] 20:19:03.004459 tst iperf3m4.py:8: Test FAILED (10.7 sec) 20:19:03.033943 run osmo-hlr_10.42.42.2(pid=10868): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10868)] 20:19:03.084862 run osmo-hlr_10.42.42.2(pid=10868): stdout: | (launched: 2022-12-09_20:18:59.648000) 20:19:03.137630 run osmo-hlr_10.42.42.2(pid=10868): stderr: | 20221209201859822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201859822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201859822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201859823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201859823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201859823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201859839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201859847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201859847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201859847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:03.190802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Terminating (SIGTERM) 20:19:03.233256 run iperf3-srv_10.42.42.10(pid=10858): Terminating (SIGTERM) 20:19:03.275728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Terminating (SIGTERM) 20:19:03.318316 run iperf3-srv_10.42.42.10(pid=10860): Terminating (SIGTERM) 20:19:03.360815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10861): Terminating (SIGTERM) 20:19:03.403245 run iperf3-srv_10.42.42.10(pid=10862): Terminating (SIGTERM) 20:19:03.445750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10863): Terminating (SIGTERM) 20:19:03.488053 run iperf3-srv_10.42.42.10(pid=10864): Terminating (SIGTERM) 20:19:03.530347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Terminating (SIGTERM) 20:19:03.573075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Terminating (SIGTERM) 20:19:03.615705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10873): Terminating (SIGTERM) 20:19:03.658837 --- ParallelTerminationStrategy: PID 10857 died... 20:19:03.679170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10857): Terminated: ok {rc=0} 20:19:03.726083 --- ParallelTerminationStrategy: PID 10858 died... 20:19:03.746032 run iperf3-srv_10.42.42.10(pid=10858): Terminated {rc=256} 20:19:03.793205 --- ParallelTerminationStrategy: PID 10859 died... 20:19:03.812862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10859): Terminated: ok {rc=0} 20:19:03.859388 --- ParallelTerminationStrategy: PID 10860 died... 20:19:03.879123 run iperf3-srv_10.42.42.10(pid=10860): Terminated {rc=256} 20:19:03.925740 --- ParallelTerminationStrategy: PID 10861 died... 20:19:03.945485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10861): Terminated: ok {rc=0} 20:19:03.992145 --- ParallelTerminationStrategy: PID 10862 died... 20:19:04.011957 run iperf3-srv_10.42.42.10(pid=10862): Terminated {rc=256} 20:19:04.058684 --- ParallelTerminationStrategy: PID 10863 died... 20:19:04.078581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10863): Terminated: ok {rc=0} 20:19:04.125405 --- ParallelTerminationStrategy: PID 10864 died... 20:19:04.145219 run iperf3-srv_10.42.42.10(pid=10864): Terminated {rc=256} 20:19:04.192476 --- ParallelTerminationStrategy: PID 10867 died... 20:19:04.212512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10867): Terminated: ok {rc=0} 20:19:04.259438 --- ParallelTerminationStrategy: PID 10870 died... 20:19:04.279373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10870): Terminated: ok {rc=0} 20:19:04.326182 --- ParallelTerminationStrategy: PID 10873 died... 20:19:04.346309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10873): Terminated: ok {rc=0} 20:19:04.435202 bus /gobi_4: Setting Powered False 20:19:05.535342 bus /gobi_4: Setting Powered False 20:19:06.652699 bus /gobi_1: Setting Powered False 20:19:07.751561 bus /gobi_1: Setting Powered False 20:19:08.867948 bus /gobi_0: Setting Powered False 20:19:09.966676 bus /gobi_0: Setting Powered False 20:19:11.084071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g ping.py ---------------------------------------------- 20:19:12.185560 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.196453 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:19:12.232009 tst ping.py: using LAC 23473 20:19:12.350943 tst ping.py: using RAC 13 20:19:12.478689 tst ping.py: using CellId 23473 20:19:12.606754 tst ping.py: using BVCI 23474 20:19:12.727447 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.738624 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.749784 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.760688 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.771411 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.782132 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.793370 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:12.804137 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:19:12.918606 tst ping.py:19: start network... 20:19:13.123341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:13.592942 run create_hlr_db(pid=10876): Launched 20:19:13.708016 bus /gobi_6: Setting Powered False 20:19:14.768557 run create_hlr_db(pid=10876): Terminated: ok {rc=0} 20:19:15.190555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Launched 20:19:15.494564 run osmo-hlr_10.42.42.2(pid=10879): Launched 20:19:15.611941 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:16.161484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Launched 20:19:16.483954 run osmo-stp_10.42.42.5(pid=10882): Launched 20:19:16.753870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:17.464360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Launched 20:19:17.580633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:17.837138 run patchelf(pid=10885): Launched 20:19:18.005510 run osmo-stp_10.42.42.5(pid=10882): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] 20:19:18.132866 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_20:19:16.425171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:18.262637 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209201916835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201916835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201916836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201916838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201916843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201916844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201916844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:18.392329 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_20:19:16.425171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:18.516250 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209201916835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201916835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201916836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201916838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201916843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201916844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201916844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:18.663231 run patchelf(pid=10885): Terminating (SIGINT) 20:19:18.833146 run patchelf(pid=10885): Terminated: ok {rc=0} 20:19:18.955699 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2364↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] [trial-2364↪gprs:oc2g↪ping.py:22] 20:19:18.964802 tst ping.py:22: Test FAILED (6.8 sec) 20:19:18.992545 run osmo-hlr_10.42.42.2(pid=10879): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10879)] 20:19:19.040711 run osmo-hlr_10.42.42.2(pid=10879): stdout: | (launched: 2022-12-09_20:19:15.438322) 20:19:19.090743 run osmo-hlr_10.42.42.2(pid=10879): stderr: | 20221209201915615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201915615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201915615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201915615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201915615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201915615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201915627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201915636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201915636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201915636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:19.141322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Terminating (SIGTERM) 20:19:19.181567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminating (SIGTERM) 20:19:19.221742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Terminating (SIGTERM) 20:19:19.262122 --- ParallelTerminationStrategy: PID 10878 died... 20:19:19.281465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10878): Terminated: ok {rc=0} 20:19:19.326049 --- ParallelTerminationStrategy: PID 10881 died... 20:19:19.344811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminated: ok {rc=0} 20:19:19.389371 --- ParallelTerminationStrategy: PID 10884 died... 20:19:19.408142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Terminated: ok {rc=0} 20:19:19.492923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 20:19:20.578552 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:20.589609 tst gprs:oc2g: Using 1 x bts (candidates: 1) 20:19:20.626121 tst ping_idle_ping.py: using LAC 23474 20:19:20.755659 tst ping_idle_ping.py: using RAC 14 20:19:20.885021 tst ping_idle_ping.py: using CellId 23474 20:19:21.014679 tst ping_idle_ping.py: using BVCI 23475 20:19:21.134595 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.145988 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.157471 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.168289 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.179200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.190175 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.201246 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 20:19:21.212165 tst gprs:oc2g: Using 1 x modem (candidates: 4) 20:19:21.331815 tst ping_idle_ping.py:24: start network... 20:19:21.551543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:22.060121 run create_hlr_db(pid=10886): Launched 20:19:22.193835 bus /gobi_6: Setting Powered False 20:19:23.258598 run create_hlr_db(pid=10886): Terminated: ok {rc=0} 20:19:23.693733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10888): Launched 20:19:23.999158 run osmo-hlr_10.42.42.2(pid=10889): Launched 20:19:24.115319 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:24.643886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10891): Launched 20:19:24.948191 run osmo-stp_10.42.42.5(pid=10892): Launched 20:19:25.064111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:25.588411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10894): Launched 20:19:25.704492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:25.961926 run patchelf(pid=10895): Launched 20:19:26.130497 run osmo-stp_10.42.42.5(pid=10892): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10892)] 20:19:26.258703 run osmo-stp_10.42.42.5(pid=10892): stdout: | (launched: 2022-12-09_20:19:24.892020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:26.389072 run osmo-stp_10.42.42.5(pid=10892): stderr: | 20221209201925062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201925062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201925062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201925063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201925063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201925063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201925064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:26.519117 run osmo-stp_10.42.42.5(pid=10892): stdout: | (launched: 2022-12-09_20:19:24.892020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:26.643549 run osmo-stp_10.42.42.5(pid=10892): stderr: | 20221209201925062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201925062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201925062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201925063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201925063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201925063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201925064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:26.790788 run patchelf(pid=10895): Terminating (SIGINT) 20:19:26.961396 run patchelf(pid=10895): Terminated: ok {rc=0} 20:19:27.084041 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10892): Process ended prematurely: osmo-stp_10.42.42.5(pid=10892) [trial-2364↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10892)] [trial-2364↪gprs:oc2g↪ping_idle_ping.py:27] 20:19:27.093231 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:19:27.120837 run osmo-hlr_10.42.42.2(pid=10889): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10889)] 20:19:27.168908 run osmo-hlr_10.42.42.2(pid=10889): stdout: | (launched: 2022-12-09_20:19:23.942781) 20:19:27.218746 run osmo-hlr_10.42.42.2(pid=10889): stderr: | 20221209201924120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201924120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201924120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201924120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201924120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201924120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201924132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201924141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201924141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201924141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:27.268942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10888): Terminating (SIGTERM) 20:19:27.308822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10891): Terminating (SIGTERM) 20:19:27.348725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10894): Terminating (SIGTERM) 20:19:27.389188 --- ParallelTerminationStrategy: PID 10888 died... 20:19:27.408275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10888): Terminated: ok {rc=0} 20:19:27.452888 --- ParallelTerminationStrategy: PID 10891 died... 20:19:27.472083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10891): Terminated: ok {rc=0} 20:19:27.516522 --- ParallelTerminationStrategy: PID 10894 died... 20:19:27.535358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10894): Terminated: ok {rc=0} 20:19:27.619677 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 20:19:28.911162 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:19:28.917092 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:19:28.938244 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:19:28.977367 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:19:29.063638 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:19:29.084380 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:19:29.123049 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:19:29.719397 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:19:29.771448 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:29.782525 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:29.818658 tst cs_paging_gprs_active.py: using LAC 23475 20:19:29.943609 tst cs_paging_gprs_active.py: using RAC 15 20:19:30.082996 tst cs_paging_gprs_active.py: using CellId 23475 20:19:30.213138 tst cs_paging_gprs_active.py: using BVCI 23476 20:19:30.330671 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.341832 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.352695 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.363602 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.374516 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.385334 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.396304 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.407099 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:30.418117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:30.537564 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:30.652242 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:19:30.859412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:31.218634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10900): Launched 20:19:31.518768 run iperf3-srv_10.42.42.10(pid=10901): Launched 20:19:31.653060 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:19:31.881229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:32.215524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10902): Launched 20:19:32.498265 run iperf3-srv_10.42.42.10(pid=10903): Launched 20:19:32.621164 tst cs_paging_gprs_active.py:38: start network... 20:19:32.840424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:33.345251 run create_hlr_db(pid=10904): Launched 20:19:33.476062 bus /gobi_6: Setting Powered False 20:19:34.539667 run create_hlr_db(pid=10904): Terminated: ok {rc=0} 20:19:34.992570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Launched 20:19:35.316180 run osmo-hlr_10.42.42.2(pid=10919): Launched 20:19:35.439581 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:35.997751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Launched 20:19:36.322956 run osmo-stp_10.42.42.5(pid=10922): Launched 20:19:36.447013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:37.006231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10924): Launched 20:19:37.131674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:37.405293 run patchelf(pid=10925): Launched 20:19:37.585061 run osmo-stp_10.42.42.5(pid=10922): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] 20:19:37.722536 run osmo-stp_10.42.42.5(pid=10922): stdout: | (launched: 2022-12-09_20:19:36.263666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:37.861316 run osmo-stp_10.42.42.5(pid=10922): stderr: | 20221209201936456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201936456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201936456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201936457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201936457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201936457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201936457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:37.999882 run osmo-stp_10.42.42.5(pid=10922): stdout: | (launched: 2022-12-09_20:19:36.263666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:38.132382 run osmo-stp_10.42.42.5(pid=10922): stderr: | 20221209201936456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201936456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201936456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201936457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201936457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201936457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201936457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:38.289984 run patchelf(pid=10925): Terminating (SIGINT) 20:19:38.470994 run patchelf(pid=10925): Terminated: ok {rc=0} 20:19:38.601682 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10922): Process ended prematurely: osmo-stp_10.42.42.5(pid=10922) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] [trial-2364↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:19:38.612023 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:19:38.640565 run osmo-hlr_10.42.42.2(pid=10919): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10919)] 20:19:38.690977 run osmo-hlr_10.42.42.2(pid=10919): stdout: | (launched: 2022-12-09_20:19:35.257029) 20:19:38.743032 run osmo-hlr_10.42.42.2(pid=10919): stderr: | 20221209201935455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201935455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201935455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201935455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201935455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201935455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201935467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201935475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201935476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201935476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:38.795117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10900): Terminating (SIGTERM) 20:19:38.836731 run iperf3-srv_10.42.42.10(pid=10901): Terminating (SIGTERM) 20:19:38.878456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10902): Terminating (SIGTERM) 20:19:38.920187 run iperf3-srv_10.42.42.10(pid=10903): Terminating (SIGTERM) 20:19:38.961728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Terminating (SIGTERM) 20:19:39.003655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Terminating (SIGTERM) 20:19:39.045254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10924): Terminating (SIGTERM) 20:19:39.087257 --- ParallelTerminationStrategy: PID 10900 died... 20:19:39.107077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10900): Terminated: ok {rc=0} 20:19:39.153111 --- ParallelTerminationStrategy: PID 10901 died... 20:19:39.172189 run iperf3-srv_10.42.42.10(pid=10901): Terminated {rc=256} 20:19:39.217363 --- ParallelTerminationStrategy: PID 10902 died... 20:19:39.236354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10902): Terminated: ok {rc=0} 20:19:39.281624 --- ParallelTerminationStrategy: PID 10903 died... 20:19:39.300688 run iperf3-srv_10.42.42.10(pid=10903): Terminated {rc=256} 20:19:39.346109 --- ParallelTerminationStrategy: PID 10906 died... 20:19:39.365660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10906): Terminated: ok {rc=0} 20:19:39.411401 --- ParallelTerminationStrategy: PID 10921 died... 20:19:39.430701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10921): Terminated: ok {rc=0} 20:19:39.476076 --- ParallelTerminationStrategy: PID 10924 died... 20:19:39.495336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10924): Terminated: ok {rc=0} 20:19:39.582003 bus /gobi_0: Setting Powered False 20:19:40.681776 bus /gobi_0: Setting Powered False 20:19:41.796674 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:19:42.945678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:42.958005 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:42.996124 tst iperf3.py: using LAC 23476 20:19:43.127714 tst iperf3.py: using RAC 16 20:19:43.253413 tst iperf3.py: using CellId 23476 20:19:43.382913 tst iperf3.py: using BVCI 23477 20:19:43.500718 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.511980 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.523007 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.534091 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.544930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.555838 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.566996 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.578009 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:43.588931 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:43.710262 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:43.930527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:44.256536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10926): Launched 20:19:44.538682 run iperf3-srv_10.42.42.10(pid=10927): Launched 20:19:44.659401 tst iperf3.py:8: start network... 20:19:44.877849 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:45.379190 run create_hlr_db(pid=10928): Launched 20:19:45.509146 bus /gobi_6: Setting Powered False 20:19:46.568301 run create_hlr_db(pid=10928): Terminated: ok {rc=0} 20:19:47.002090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Launched 20:19:47.319641 run osmo-hlr_10.42.42.2(pid=10931): Launched 20:19:47.437900 run osmo-stp_10.42.42.5: Starting osmo-stp 20:19:47.971852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Launched 20:19:48.275718 run osmo-stp_10.42.42.5(pid=10934): Launched 20:19:48.391396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:19:48.915883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10936): Launched 20:19:49.032254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:19:49.288126 run patchelf(pid=10937): Launched 20:19:49.456001 run osmo-stp_10.42.42.5(pid=10934): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] 20:19:49.584257 run osmo-stp_10.42.42.5(pid=10934): stdout: | (launched: 2022-12-09_20:19:48.220000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:49.714797 run osmo-stp_10.42.42.5(pid=10934): stderr: | 20221209201948391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201948391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201948391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201948392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201948392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201948392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201948392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:49.845072 run osmo-stp_10.42.42.5(pid=10934): stdout: | (launched: 2022-12-09_20:19:48.220000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:19:49.969595 run osmo-stp_10.42.42.5(pid=10934): stderr: | 20221209201948391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209201948391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209201948391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209201948392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209201948392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209201948392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209201948392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:19:50.117170 run patchelf(pid=10937): Terminating (SIGINT) 20:19:50.287143 run patchelf(pid=10937): Terminated: ok {rc=0} 20:19:50.410061 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10934): Process ended prematurely: osmo-stp_10.42.42.5(pid=10934) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 20:19:50.419869 tst iperf3.py:8: Test FAILED (7.5 sec) 20:19:50.447446 run osmo-hlr_10.42.42.2(pid=10931): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10931)] 20:19:50.494910 run osmo-hlr_10.42.42.2(pid=10931): stdout: | (launched: 2022-12-09_20:19:47.264240) 20:19:50.544223 run osmo-hlr_10.42.42.2(pid=10931): stderr: | 20221209201947442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209201947442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209201947442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209201947442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209201947442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209201947442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209201947455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209201947463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209201947463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209201947463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:19:50.594320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10926): Terminating (SIGTERM) 20:19:50.634281 run iperf3-srv_10.42.42.10(pid=10927): Terminating (SIGTERM) 20:19:50.674171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Terminating (SIGTERM) 20:19:50.714268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Terminating (SIGTERM) 20:19:50.754199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10936): Terminating (SIGTERM) 20:19:50.794214 --- ParallelTerminationStrategy: PID 10926 died... 20:19:50.813222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10926): Terminated: ok {rc=0} 20:19:50.857953 --- ParallelTerminationStrategy: PID 10927 died... 20:19:50.876630 run iperf3-srv_10.42.42.10(pid=10927): Terminated {rc=256} 20:19:50.920739 --- ParallelTerminationStrategy: PID 10930 died... 20:19:50.939419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10930): Terminated: ok {rc=0} 20:19:50.984281 --- ParallelTerminationStrategy: PID 10933 died... 20:19:51.003014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10933): Terminated: ok {rc=0} 20:19:51.047727 --- ParallelTerminationStrategy: PID 10936 died... 20:19:51.066625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10936): Terminated: ok {rc=0} 20:19:51.151641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:19:52.302946 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.314951 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:19:52.354631 tst iperf3m4.py: using LAC 23477 20:19:52.475533 tst iperf3m4.py: using RAC 17 20:19:52.594272 tst iperf3m4.py: using CellId 23477 20:19:52.716234 tst iperf3m4.py: using BVCI 23478 20:19:52.828060 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.838776 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.849368 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.860228 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.870969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.881725 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.892493 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.903111 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:19:52.914026 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:53.034758 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:53.153155 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:53.273535 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:19:53.394054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:19:53.614660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:53.942295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Launched 20:19:54.225962 run iperf3-srv_10.42.42.10(pid=10939): Launched 20:19:54.347142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:19:54.564909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:54.890339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10940): Launched 20:19:55.173662 run iperf3-srv_10.42.42.10(pid=10941): Launched 20:19:55.294604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:19:55.512073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:55.838307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Launched 20:19:56.121096 run iperf3-srv_10.42.42.10(pid=10943): Launched 20:19:56.241735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:19:56.458621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:19:56.784091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10944): Launched 20:19:57.066232 run iperf3-srv_10.42.42.10(pid=10945): Launched 20:19:57.186790 tst iperf3m4.py:8: start network... 20:19:57.404544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:19:57.906928 run create_hlr_db(pid=10946): Launched 20:19:58.038785 bus /gobi_6: Setting Powered False 20:19:59.102697 run create_hlr_db(pid=10946): Terminated: ok {rc=0} 20:19:59.553327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10948): Launched 20:19:59.876449 run osmo-hlr_10.42.42.2(pid=10949): Launched 20:19:59.998880 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:00.559561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10951): Launched 20:20:00.905428 run osmo-stp_10.42.42.5(pid=10952): Launched 20:20:01.204631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:01.780668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Launched 20:20:01.913199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:02.181334 run patchelf(pid=10958): Launched 20:20:02.369097 run osmo-stp_10.42.42.5(pid=10952): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10952)] 20:20:02.501183 run osmo-stp_10.42.42.5(pid=10952): stdout: | (launched: 2022-12-09_20:20:00.824491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:02.631857 run osmo-stp_10.42.42.5(pid=10952): stderr: | 20221209202001079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202001079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202001079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202001080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202001080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202001080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202001081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:02.763773 run osmo-stp_10.42.42.5(pid=10952): stdout: | (launched: 2022-12-09_20:20:00.824491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:02.888909 run osmo-stp_10.42.42.5(pid=10952): stderr: | 20221209202001079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202001079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202001079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202001080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202001080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202001080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202001081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:03.037822 run patchelf(pid=10958): Terminating (SIGINT) 20:20:03.208170 run patchelf(pid=10958): Terminated: ok {rc=0} 20:20:03.332096 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10952): Process ended prematurely: osmo-stp_10.42.42.5(pid=10952) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10952)] [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 20:20:03.342169 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:20:03.370126 run osmo-hlr_10.42.42.2(pid=10949): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10949)] 20:20:03.417838 run osmo-hlr_10.42.42.2(pid=10949): stdout: | (launched: 2022-12-09_20:19:59.816796) 20:20:03.466977 run osmo-hlr_10.42.42.2(pid=10949): stderr: | 20221209202000013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202000013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202000013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202000013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202000013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202000013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202000027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202000037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202000037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202000037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:03.517450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Terminating (SIGTERM) 20:20:03.558489 run iperf3-srv_10.42.42.10(pid=10939): Terminating (SIGTERM) 20:20:03.597927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10940): Terminating (SIGTERM) 20:20:03.637819 run iperf3-srv_10.42.42.10(pid=10941): Terminating (SIGTERM) 20:20:03.678335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Terminating (SIGTERM) 20:20:03.717857 run iperf3-srv_10.42.42.10(pid=10943): Terminating (SIGTERM) 20:20:03.757359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10944): Terminating (SIGTERM) 20:20:03.797642 run iperf3-srv_10.42.42.10(pid=10945): Terminating (SIGTERM) 20:20:03.839220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10948): Terminating (SIGTERM) 20:20:03.878869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10951): Terminating (SIGTERM) 20:20:03.919067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Terminating (SIGTERM) 20:20:03.958931 --- ParallelTerminationStrategy: PID 10938 died... 20:20:03.977707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10938): Terminated: ok {rc=0} 20:20:04.022276 --- ParallelTerminationStrategy: PID 10939 died... 20:20:04.041799 run iperf3-srv_10.42.42.10(pid=10939): Terminated {rc=256} 20:20:04.088055 --- ParallelTerminationStrategy: PID 10940 died... 20:20:04.107408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10940): Terminated: ok {rc=0} 20:20:04.152289 --- ParallelTerminationStrategy: PID 10941 died... 20:20:04.171123 run iperf3-srv_10.42.42.10(pid=10941): Terminated {rc=256} 20:20:04.215093 --- ParallelTerminationStrategy: PID 10942 died... 20:20:04.234538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Terminated: ok {rc=0} 20:20:04.279357 --- ParallelTerminationStrategy: PID 10943 died... 20:20:04.298231 run iperf3-srv_10.42.42.10(pid=10943): Terminated {rc=256} 20:20:04.343362 --- ParallelTerminationStrategy: PID 10944 died... 20:20:04.362413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10944): Terminated: ok {rc=0} 20:20:04.407056 --- ParallelTerminationStrategy: PID 10945 died... 20:20:04.425888 run iperf3-srv_10.42.42.10(pid=10945): Terminated {rc=256} 20:20:04.470555 --- ParallelTerminationStrategy: PID 10948 died... 20:20:04.489336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10948): Terminated: ok {rc=0} 20:20:04.533680 --- ParallelTerminationStrategy: PID 10951 died... 20:20:04.552786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10951): Terminated: ok {rc=0} 20:20:04.597535 --- ParallelTerminationStrategy: PID 10957 died... 20:20:04.616470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Terminated: ok {rc=0} 20:20:04.701900 bus /gobi_4: Setting Powered False 20:20:05.799669 bus /gobi_4: Setting Powered False 20:20:06.917086 bus /gobi_1: Setting Powered False 20:20:08.015736 bus /gobi_1: Setting Powered False 20:20:09.131894 bus /gobi_0: Setting Powered False 20:20:10.231765 bus /gobi_0: Setting Powered False 20:20:11.348722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 20:20:12.451625 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:12.463123 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:12.501328 tst ping.py: using LAC 23478 20:20:12.624553 tst ping.py: using RAC 18 20:20:12.750343 tst ping.py: using CellId 23478 20:20:12.869450 tst ping.py: using BVCI 23479 20:20:12.979901 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:12.990816 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.001674 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.012518 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.023367 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.034214 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.045041 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:13.055811 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:13.171823 tst ping.py:19: start network... 20:20:13.371570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:13.834162 run create_hlr_db(pid=10960): Launched 20:20:13.949207 bus /gobi_6: Setting Powered False 20:20:15.008793 run create_hlr_db(pid=10960): Terminated: ok {rc=0} 20:20:15.447231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Launched 20:20:15.769113 run osmo-hlr_10.42.42.2(pid=10963): Launched 20:20:15.961595 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:16.657499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Launched 20:20:16.974466 run osmo-stp_10.42.42.5(pid=10966): Launched 20:20:17.293183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:17.846145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10968): Launched 20:20:17.966967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:18.236759 run patchelf(pid=10969): Launched 20:20:18.413178 run osmo-stp_10.42.42.5(pid=10966): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] 20:20:18.547926 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-09_20:20:16.912123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:18.684390 run osmo-stp_10.42.42.5(pid=10966): stderr: | 20221209202017124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202017124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202017124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202017125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202017131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202017131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202017132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:18.821342 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-09_20:20:16.912123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:18.951913 run osmo-stp_10.42.42.5(pid=10966): stderr: | 20221209202017124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202017124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202017124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202017125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202017131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202017131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202017132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:19.106909 run patchelf(pid=10969): Terminating (SIGINT) 20:20:19.285906 run patchelf(pid=10969): Terminated: ok {rc=0} 20:20:19.414896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 20:20:19.424514 tst ping.py:22: Test FAILED (7.0 sec) 20:20:19.452732 run osmo-hlr_10.42.42.2(pid=10963): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10963)] 20:20:19.502683 run osmo-hlr_10.42.42.2(pid=10963): stdout: | (launched: 2022-12-09_20:20:15.710284) 20:20:19.554369 run osmo-hlr_10.42.42.2(pid=10963): stderr: | 20221209202015915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202015915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202015915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202015915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202015915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202015916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202015935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202015956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202015956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202015957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:19.606642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminating (SIGTERM) 20:20:19.648253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminating (SIGTERM) 20:20:19.690256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10968): Terminating (SIGTERM) 20:20:19.732295 --- ParallelTerminationStrategy: PID 10962 died... 20:20:19.752338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminated: ok {rc=0} 20:20:19.798321 --- ParallelTerminationStrategy: PID 10965 died... 20:20:19.817949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminated: ok {rc=0} 20:20:19.864055 --- ParallelTerminationStrategy: PID 10968 died... 20:20:19.883537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10968): Terminated: ok {rc=0} 20:20:19.971393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:20:21.058941 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.070738 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:20:21.108125 tst ping_idle_ping.py: using LAC 23479 20:20:21.234571 tst ping_idle_ping.py: using RAC 19 20:20:21.361418 tst ping_idle_ping.py: using CellId 23479 20:20:21.487639 tst ping_idle_ping.py: using BVCI 23480 20:20:21.603910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.615227 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.626339 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.637374 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.648165 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.659280 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.670504 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:20:21.681588 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:20:21.800904 tst ping_idle_ping.py:24: start network... 20:20:22.015772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:22.514256 run create_hlr_db(pid=10970): Launched 20:20:22.645798 bus /gobi_6: Setting Powered False 20:20:23.709818 run create_hlr_db(pid=10970): Terminated: ok {rc=0} 20:20:24.139674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Launched 20:20:24.440727 run osmo-hlr_10.42.42.2(pid=10973): Launched 20:20:24.555208 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:25.071985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Launched 20:20:25.371170 run osmo-stp_10.42.42.5(pid=10976): Launched 20:20:25.485271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:26.003961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Launched 20:20:26.118398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:26.372311 run patchelf(pid=10979): Launched 20:20:26.538983 run osmo-stp_10.42.42.5(pid=10976): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] 20:20:26.666296 run osmo-stp_10.42.42.5(pid=10976): stdout: | (launched: 2022-12-09_20:20:25.316021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:26.795439 run osmo-stp_10.42.42.5(pid=10976): stderr: | 20221209202025486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202025487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202025487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202025487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202025488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202025488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202025488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:26.924787 run osmo-stp_10.42.42.5(pid=10976): stdout: | (launched: 2022-12-09_20:20:25.316021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:27.048162 run osmo-stp_10.42.42.5(pid=10976): stderr: | 20221209202025486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202025487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202025487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202025487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202025488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202025488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202025488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:27.194584 run patchelf(pid=10979): Terminating (SIGINT) 20:20:27.363141 run patchelf(pid=10979): Terminated: ok {rc=0} 20:20:27.484746 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10976): Process ended prematurely: osmo-stp_10.42.42.5(pid=10976) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 20:20:27.493973 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:20:27.521898 run osmo-hlr_10.42.42.2(pid=10973): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10973)] 20:20:27.570364 run osmo-hlr_10.42.42.2(pid=10973): stdout: | (launched: 2022-12-09_20:20:24.385419) 20:20:27.620749 run osmo-hlr_10.42.42.2(pid=10973): stderr: | 20221209202024561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202024561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202024561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202024561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202024561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202024561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202024574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202024582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202024582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202024582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:27.671470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Terminating (SIGTERM) 20:20:27.711626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Terminating (SIGTERM) 20:20:27.751853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Terminating (SIGTERM) 20:20:27.792611 --- ParallelTerminationStrategy: PID 10972 died... 20:20:27.811850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10972): Terminated: ok {rc=0} 20:20:27.857089 --- ParallelTerminationStrategy: PID 10975 died... 20:20:27.875985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10975): Terminated: ok {rc=0} 20:20:27.920755 --- ParallelTerminationStrategy: PID 10978 died... 20:20:27.939675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10978): Terminated: ok {rc=0} 20:20:28.024568 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:20:29.326382 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:20:29.333111 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:20:29.356647 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:20:29.397189 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:20:29.483108 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:20:29.504443 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:20:29.544997 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:20:30.139297 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:20:30.192560 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.203850 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:30.260592 tst cs_paging_gprs_active.py: using LAC 23480 20:20:30.387225 tst cs_paging_gprs_active.py: using RAC 20 20:20:30.512841 tst cs_paging_gprs_active.py: using CellId 23480 20:20:30.638978 tst cs_paging_gprs_active.py: using BVCI 23481 20:20:30.759086 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.770397 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.781443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.792437 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.803386 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.814419 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.825572 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.836470 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:30.848786 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:30.996584 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:31.144064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:20:31.366868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:31.689135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10984): Launched 20:20:32.065720 run iperf3-srv_10.42.42.10(pid=10985): Launched 20:20:32.193879 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:20:32.404878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:32.713799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10986): Launched 20:20:32.980635 run iperf3-srv_10.42.42.10(pid=10987): Launched 20:20:33.095216 tst cs_paging_gprs_active.py:38: start network... 20:20:33.300660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:33.773895 run create_hlr_db(pid=10988): Launched 20:20:33.891294 bus /gobi_6: Setting Powered False 20:20:34.951380 run create_hlr_db(pid=10988): Terminated: ok {rc=0} 20:20:35.376347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10990): Launched 20:20:35.681464 run osmo-hlr_10.42.42.2(pid=10992): Launched 20:20:35.797870 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:36.322487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10994): Launched 20:20:36.627493 run osmo-stp_10.42.42.5(pid=10995): Launched 20:20:36.743434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:37.269622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Launched 20:20:37.386614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:37.645570 run patchelf(pid=10999): Launched 20:20:37.815031 run osmo-stp_10.42.42.5(pid=10995): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10995)] 20:20:37.944790 run osmo-stp_10.42.42.5(pid=10995): stdout: | (launched: 2022-12-09_20:20:36.571414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:38.075897 run osmo-stp_10.42.42.5(pid=10995): stderr: | 20221209202036740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202036740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202036740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202036741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202036741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202036741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202036741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:38.207154 run osmo-stp_10.42.42.5(pid=10995): stdout: | (launched: 2022-12-09_20:20:36.571414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:38.332767 run osmo-stp_10.42.42.5(pid=10995): stderr: | 20221209202036740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202036740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202036740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202036741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202036741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202036741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202036741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:38.481459 run patchelf(pid=10999): Terminating (SIGINT) 20:20:38.653592 run patchelf(pid=10999): Terminated: ok {rc=0} 20:20:38.778117 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10995): Process ended prematurely: osmo-stp_10.42.42.5(pid=10995) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10995)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:20:38.787669 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:20:38.815458 run osmo-hlr_10.42.42.2(pid=10992): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10992)] 20:20:38.863280 run osmo-hlr_10.42.42.2(pid=10992): stdout: | (launched: 2022-12-09_20:20:35.625271) 20:20:38.912707 run osmo-hlr_10.42.42.2(pid=10992): stderr: | 20221209202035802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202035803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202035803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202035803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202035803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202035803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202035815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202035824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202035824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202035824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:38.962734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10984): Terminating (SIGTERM) 20:20:39.002513 run iperf3-srv_10.42.42.10(pid=10985): Terminating (SIGTERM) 20:20:39.042327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10986): Terminating (SIGTERM) 20:20:39.082219 run iperf3-srv_10.42.42.10(pid=10987): Terminating (SIGTERM) 20:20:39.122043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10990): Terminating (SIGTERM) 20:20:39.162252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10994): Terminating (SIGTERM) 20:20:39.201975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Terminating (SIGTERM) 20:20:39.242045 --- ParallelTerminationStrategy: PID 10984 died... 20:20:39.261081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10984): Terminated: ok {rc=0} 20:20:39.305277 --- ParallelTerminationStrategy: PID 10985 died... 20:20:39.323482 run iperf3-srv_10.42.42.10(pid=10985): Terminated {rc=256} 20:20:39.367597 --- ParallelTerminationStrategy: PID 10986 died... 20:20:39.386284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10986): Terminated: ok {rc=0} 20:20:39.430635 --- ParallelTerminationStrategy: PID 10987 died... 20:20:39.449006 run iperf3-srv_10.42.42.10(pid=10987): Terminated {rc=256} 20:20:39.493224 --- ParallelTerminationStrategy: PID 10990 died... 20:20:39.511786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10990): Terminated: ok {rc=0} 20:20:39.555872 --- ParallelTerminationStrategy: PID 10994 died... 20:20:39.574252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10994): Terminated: ok {rc=0} 20:20:39.618439 --- ParallelTerminationStrategy: PID 10998 died... 20:20:39.637105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10998): Terminated: ok {rc=0} 20:20:39.722227 bus /gobi_0: Setting Powered False 20:20:40.821597 bus /gobi_0: Setting Powered False 20:20:41.937639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:20:43.086917 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.098788 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:43.158575 tst iperf3.py: using LAC 23481 20:20:43.292146 tst iperf3.py: using RAC 21 20:20:43.418291 tst iperf3.py: using CellId 23481 20:20:43.545606 tst iperf3.py: using BVCI 23482 20:20:43.663766 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.675079 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.686140 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.697495 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.708751 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.719791 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.730974 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.741963 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:43.753358 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:43.872573 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:44.092114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:44.418959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Launched 20:20:44.702045 run iperf3-srv_10.42.42.10(pid=11001): Launched 20:20:44.824936 tst iperf3.py:8: start network... 20:20:45.044420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:45.547768 run create_hlr_db(pid=11002): Launched 20:20:45.678892 bus /gobi_6: Setting Powered False 20:20:46.742283 run create_hlr_db(pid=11002): Terminated: ok {rc=0} 20:20:47.221653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Launched 20:20:47.527577 run osmo-hlr_10.42.42.2(pid=11005): Launched 20:20:47.643922 run osmo-stp_10.42.42.5: Starting osmo-stp 20:20:48.184149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Launched 20:20:48.489910 run osmo-stp_10.42.42.5(pid=11008): Launched 20:20:48.609461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:20:49.134851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Launched 20:20:49.252663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:20:49.511085 run patchelf(pid=11011): Launched 20:20:49.680152 run osmo-stp_10.42.42.5(pid=11008): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] 20:20:49.809863 run osmo-stp_10.42.42.5(pid=11008): stdout: | (launched: 2022-12-09_20:20:48.433907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:49.940605 run osmo-stp_10.42.42.5(pid=11008): stderr: | 20221209202048604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202048605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202048605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202048605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202048606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202048606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202048606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:50.071388 run osmo-stp_10.42.42.5(pid=11008): stdout: | (launched: 2022-12-09_20:20:48.433907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:20:50.196375 run osmo-stp_10.42.42.5(pid=11008): stderr: | 20221209202048604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202048605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202048605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202048605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202048606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202048606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202048606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:20:50.344879 run patchelf(pid=11011): Terminating (SIGINT) 20:20:50.516246 run patchelf(pid=11011): Terminated: ok {rc=0} 20:20:50.640612 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11008): Process ended prematurely: osmo-stp_10.42.42.5(pid=11008) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 20:20:50.650583 tst iperf3.py:8: Test FAILED (7.6 sec) 20:20:50.678399 run osmo-hlr_10.42.42.2(pid=11005): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11005)] 20:20:50.726175 run osmo-hlr_10.42.42.2(pid=11005): stdout: | (launched: 2022-12-09_20:20:47.471262) 20:20:50.775615 run osmo-hlr_10.42.42.2(pid=11005): stderr: | 20221209202047646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202047646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202047646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202047646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202047646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202047646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202047658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202047667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202047668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202047668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:20:50.825837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Terminating (SIGTERM) 20:20:50.865904 run iperf3-srv_10.42.42.10(pid=11001): Terminating (SIGTERM) 20:20:50.906029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Terminating (SIGTERM) 20:20:50.946222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Terminating (SIGTERM) 20:20:50.986370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Terminating (SIGTERM) 20:20:51.026825 --- ParallelTerminationStrategy: PID 11000 died... 20:20:51.045989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Terminated: ok {rc=0} 20:20:51.091137 --- ParallelTerminationStrategy: PID 11001 died... 20:20:51.109832 run iperf3-srv_10.42.42.10(pid=11001): Terminated {rc=256} 20:20:51.154179 --- ParallelTerminationStrategy: PID 11004 died... 20:20:51.172786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Terminated: ok {rc=0} 20:20:51.217239 --- ParallelTerminationStrategy: PID 11007 died... 20:20:51.235743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Terminated: ok {rc=0} 20:20:51.281069 --- ParallelTerminationStrategy: PID 11010 died... 20:20:51.299687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Terminated: ok {rc=0} 20:20:51.386554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:20:52.532445 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:52.544100 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:20:52.602368 tst iperf3m4.py: using LAC 23482 20:20:52.732446 tst iperf3m4.py: using RAC 22 20:20:52.861612 tst iperf3m4.py: using CellId 23482 20:20:52.994827 tst iperf3m4.py: using BVCI 23483 20:20:53.114973 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.126523 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.137795 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.148934 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.159993 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.170976 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.182196 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.193155 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:20:53.204413 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:53.320311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:53.444116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:53.563928 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:20:53.686063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:20:53.906558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:54.232875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Launched 20:20:54.517193 run iperf3-srv_10.42.42.10(pid=11013): Launched 20:20:54.639049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:20:54.858496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:55.185743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11014): Launched 20:20:55.469186 run iperf3-srv_10.42.42.10(pid=11015): Launched 20:20:55.591232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:20:55.811392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:56.138941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11016): Launched 20:20:56.421503 run iperf3-srv_10.42.42.10(pid=11035): Launched 20:20:56.545329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:20:56.765107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:20:57.091585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11037): Launched 20:20:57.376168 run iperf3-srv_10.42.42.10(pid=11038): Launched 20:20:57.497603 tst iperf3m4.py:8: start network... 20:20:57.717055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:20:58.223173 run create_hlr_db(pid=11039): Launched 20:20:58.353959 bus /gobi_6: Setting Powered False 20:20:59.418520 run create_hlr_db(pid=11039): Terminated: ok {rc=0} 20:20:59.853840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Launched 20:21:00.161220 run osmo-hlr_10.42.42.2(pid=11042): Launched 20:21:00.277298 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:00.812148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11045): Launched 20:21:01.188468 run osmo-stp_10.42.42.5(pid=11046): Launched 20:21:01.473241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:02.067966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11048): Launched 20:21:02.195416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:02.454639 run patchelf(pid=11049): Launched 20:21:02.626425 run osmo-stp_10.42.42.5(pid=11046): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11046)] 20:21:02.756038 run osmo-stp_10.42.42.5(pid=11046): stdout: | (launched: 2022-12-09_20:21:01.121713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:02.887092 run osmo-stp_10.42.42.5(pid=11046): stderr: | 20221209202101388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202101388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202101388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202101389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202101389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202101390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202101390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:03.018266 run osmo-stp_10.42.42.5(pid=11046): stdout: | (launched: 2022-12-09_20:21:01.121713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:03.144154 run osmo-stp_10.42.42.5(pid=11046): stderr: | 20221209202101388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202101388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202101388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202101389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202101389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202101390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202101390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:03.293148 run patchelf(pid=11049): Terminating (SIGINT) 20:21:03.464474 run patchelf(pid=11049): Terminated: ok {rc=0} 20:21:03.588645 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11046): Process ended prematurely: osmo-stp_10.42.42.5(pid=11046) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11046)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:21:03.598879 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:21:03.627324 run osmo-hlr_10.42.42.2(pid=11042): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11042)] 20:21:03.675183 run osmo-hlr_10.42.42.2(pid=11042): stdout: | (launched: 2022-12-09_20:21:00.103638) 20:21:03.725057 run osmo-hlr_10.42.42.2(pid=11042): stderr: | 20221209202100277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202100278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202100278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202100278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202100278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202100278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202100290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202100301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202100301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202100301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:03.775193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminating (SIGTERM) 20:21:03.815410 run iperf3-srv_10.42.42.10(pid=11013): Terminating (SIGTERM) 20:21:03.855426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11014): Terminating (SIGTERM) 20:21:03.895455 run iperf3-srv_10.42.42.10(pid=11015): Terminating (SIGTERM) 20:21:03.935282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11016): Terminating (SIGTERM) 20:21:03.975313 run iperf3-srv_10.42.42.10(pid=11035): Terminating (SIGTERM) 20:21:04.015248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11037): Terminating (SIGTERM) 20:21:04.055172 run iperf3-srv_10.42.42.10(pid=11038): Terminating (SIGTERM) 20:21:04.095075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Terminating (SIGTERM) 20:21:04.135023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11045): Terminating (SIGTERM) 20:21:04.175451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11048): Terminating (SIGTERM) 20:21:04.215788 --- ParallelTerminationStrategy: PID 11012 died... 20:21:04.234515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminated: ok {rc=0} 20:21:04.279107 --- ParallelTerminationStrategy: PID 11013 died... 20:21:04.297722 run iperf3-srv_10.42.42.10(pid=11013): Terminated {rc=256} 20:21:04.342259 --- ParallelTerminationStrategy: PID 11014 died... 20:21:04.360799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11014): Terminated: ok {rc=0} 20:21:04.405416 --- ParallelTerminationStrategy: PID 11015 died... 20:21:04.423976 run iperf3-srv_10.42.42.10(pid=11015): Terminated {rc=256} 20:21:04.468358 --- ParallelTerminationStrategy: PID 11016 died... 20:21:04.486963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11016): Terminated: ok {rc=0} 20:21:04.531313 --- ParallelTerminationStrategy: PID 11035 died... 20:21:04.550022 run iperf3-srv_10.42.42.10(pid=11035): Terminated {rc=256} 20:21:04.594405 --- ParallelTerminationStrategy: PID 11037 died... 20:21:04.613046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11037): Terminated: ok {rc=0} 20:21:04.657428 --- ParallelTerminationStrategy: PID 11038 died... 20:21:04.675970 run iperf3-srv_10.42.42.10(pid=11038): Terminated {rc=256} 20:21:04.720258 --- ParallelTerminationStrategy: PID 11041 died... 20:21:04.738904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11041): Terminated: ok {rc=0} 20:21:04.783264 --- ParallelTerminationStrategy: PID 11045 died... 20:21:04.801936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11045): Terminated: ok {rc=0} 20:21:04.846197 --- ParallelTerminationStrategy: PID 11048 died... 20:21:04.865246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11048): Terminated: ok {rc=0} 20:21:04.951664 bus /gobi_4: Setting Powered False 20:21:06.052012 bus /gobi_4: Setting Powered False 20:21:07.168197 bus /gobi_1: Setting Powered False 20:21:08.266844 bus /gobi_1: Setting Powered False 20:21:09.382471 bus /gobi_0: Setting Powered False 20:21:10.481221 bus /gobi_0: Setting Powered False 20:21:11.597908 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:21:12.700168 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:12.711881 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:12.769598 tst ping.py: using LAC 23483 20:21:12.899628 tst ping.py: using RAC 23 20:21:13.024940 tst ping.py: using CellId 23483 20:21:13.148325 tst ping.py: using BVCI 23484 20:21:13.264640 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.276143 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.287470 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.298600 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.309675 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.320596 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.331897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:13.343058 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:13.456480 tst ping.py:19: start network... 20:21:13.658521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:14.125730 run create_hlr_db(pid=11050): Launched 20:21:14.240421 bus /gobi_6: Setting Powered False 20:21:15.300705 run create_hlr_db(pid=11050): Terminated: ok {rc=0} 20:21:15.741095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11053): Launched 20:21:16.067283 run osmo-hlr_10.42.42.2(pid=11054): Launched 20:21:16.356243 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:16.952701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11056): Launched 20:21:17.288228 run osmo-stp_10.42.42.5(pid=11057): Launched 20:21:17.410795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:17.966741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11059): Launched 20:21:18.090621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:18.363024 run patchelf(pid=11060): Launched 20:21:18.542400 run osmo-stp_10.42.42.5(pid=11057): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11057)] 20:21:18.678643 run osmo-stp_10.42.42.5(pid=11057): stdout: | (launched: 2022-12-09_20:21:17.229715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:18.816480 run osmo-stp_10.42.42.5(pid=11057): stderr: | 20221209202117422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202117422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202117422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202117423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202117423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202117423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202117423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:18.954150 run osmo-stp_10.42.42.5(pid=11057): stdout: | (launched: 2022-12-09_20:21:17.229715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:19.085836 run osmo-stp_10.42.42.5(pid=11057): stderr: | 20221209202117422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202117422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202117422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202117423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202117423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202117423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202117423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:19.241901 run patchelf(pid=11060): Terminating (SIGINT) 20:21:19.420885 run patchelf(pid=11060): Terminated: ok {rc=0} 20:21:19.550774 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11057): Process ended prematurely: osmo-stp_10.42.42.5(pid=11057) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11057)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 20:21:19.560876 tst ping.py:22: Test FAILED (6.9 sec) 20:21:19.589366 run osmo-hlr_10.42.42.2(pid=11054): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11054)] 20:21:19.639697 run osmo-hlr_10.42.42.2(pid=11054): stdout: | (launched: 2022-12-09_20:21:16.009695) 20:21:19.691819 run osmo-hlr_10.42.42.2(pid=11054): stderr: | 20221209202116268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202116268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202116268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202116268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202116268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202116268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202116283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202116296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202116296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202116296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:19.744731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11053): Terminating (SIGTERM) 20:21:19.786918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11056): Terminating (SIGTERM) 20:21:19.829139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11059): Terminating (SIGTERM) 20:21:19.871406 --- ParallelTerminationStrategy: PID 11053 died... 20:21:19.891791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11053): Terminated: ok {rc=0} 20:21:19.939046 --- ParallelTerminationStrategy: PID 11056 died... 20:21:19.958754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11056): Terminated: ok {rc=0} 20:21:20.005198 --- ParallelTerminationStrategy: PID 11059 died... 20:21:20.024820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11059): Terminated: ok {rc=0} 20:21:20.113499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:21:21.200526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.212590 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:21:21.270679 tst ping_idle_ping.py: using LAC 23484 20:21:21.398615 tst ping_idle_ping.py: using RAC 24 20:21:21.526114 tst ping_idle_ping.py: using CellId 23484 20:21:21.651446 tst ping_idle_ping.py: using BVCI 23485 20:21:21.764359 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.775551 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.786501 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.797975 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.809243 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.820365 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.831728 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:21:21.843050 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:21:21.962557 tst ping_idle_ping.py:24: start network... 20:21:22.164506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:22.633242 run create_hlr_db(pid=11061): Launched 20:21:22.747632 bus /gobi_6: Setting Powered False 20:21:23.807374 run create_hlr_db(pid=11061): Terminated: ok {rc=0} 20:21:24.248427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Launched 20:21:24.569700 run osmo-hlr_10.42.42.2(pid=11064): Launched 20:21:24.693178 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:25.245983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Launched 20:21:25.568707 run osmo-stp_10.42.42.5(pid=11067): Launched 20:21:25.694792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:26.254258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Launched 20:21:26.375877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:26.646953 run patchelf(pid=11070): Launched 20:21:26.826728 run osmo-stp_10.42.42.5(pid=11067): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] 20:21:26.962477 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-09_20:21:25.509740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:27.100230 run osmo-stp_10.42.42.5(pid=11067): stderr: | 20221209202125704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202125704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202125704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202125704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202125707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202125707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202125707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:27.238084 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-09_20:21:25.509740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:27.369544 run osmo-stp_10.42.42.5(pid=11067): stderr: | 20221209202125704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202125704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202125704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202125704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202125707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202125707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202125707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:27.526068 run patchelf(pid=11070): Terminating (SIGINT) 20:21:27.705727 run patchelf(pid=11070): Terminated: ok {rc=0} 20:21:27.835714 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:21:27.845534 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:21:27.873497 run osmo-hlr_10.42.42.2(pid=11064): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11064)] 20:21:27.923376 run osmo-hlr_10.42.42.2(pid=11064): stdout: | (launched: 2022-12-09_20:21:24.510267) 20:21:27.974981 run osmo-hlr_10.42.42.2(pid=11064): stderr: | 20221209202124709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202124709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202124709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202124709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202124709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202124709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202124721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202124729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202124730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202124730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:28.027433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminating (SIGTERM) 20:21:28.069253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminating (SIGTERM) 20:21:28.111337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Terminating (SIGTERM) 20:21:28.153769 --- ParallelTerminationStrategy: PID 11063 died... 20:21:28.173909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminated: ok {rc=0} 20:21:28.220434 --- ParallelTerminationStrategy: PID 11066 died... 20:21:28.240251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminated: ok {rc=0} 20:21:28.286707 --- ParallelTerminationStrategy: PID 11069 died... 20:21:28.306278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11069): Terminated: ok {rc=0} 20:21:28.394334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:21:29.694210 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:21:29.700914 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:21:29.722673 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:21:29.761757 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:21:29.850506 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:21:29.872140 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:21:29.910602 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:21:30.505327 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:21:30.559052 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:30.570426 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:30.629522 tst cs_paging_gprs_active.py: using LAC 23485 20:21:30.752771 tst cs_paging_gprs_active.py: using RAC 25 20:21:30.895233 tst cs_paging_gprs_active.py: using CellId 23485 20:21:31.022485 tst cs_paging_gprs_active.py: using BVCI 23486 20:21:31.144937 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.158189 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.171314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.182868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.194446 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.205929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.217656 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.228860 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:31.240479 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:31.365234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:31.495320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:21:31.729250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:32.066166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11075): Launched 20:21:32.364629 run iperf3-srv_10.42.42.10(pid=11076): Launched 20:21:32.487324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:21:32.708626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:33.038462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11077): Launched 20:21:33.322558 run iperf3-srv_10.42.42.10(pid=11078): Launched 20:21:33.445793 tst cs_paging_gprs_active.py:38: start network... 20:21:33.666401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:34.173322 run create_hlr_db(pid=11079): Launched 20:21:34.304894 bus /gobi_6: Setting Powered False 20:21:35.369029 run create_hlr_db(pid=11079): Terminated: ok {rc=0} 20:21:35.822387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11081): Launched 20:21:36.150720 run osmo-hlr_10.42.42.2(pid=11082): Launched 20:21:36.275031 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:36.840466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11084): Launched 20:21:37.167608 run osmo-stp_10.42.42.5(pid=11085): Launched 20:21:37.291308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:37.855348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11087): Launched 20:21:37.981144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:38.257488 run patchelf(pid=11088): Launched 20:21:38.439976 run osmo-stp_10.42.42.5(pid=11085): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11085)] 20:21:38.577938 run osmo-stp_10.42.42.5(pid=11085): stdout: | (launched: 2022-12-09_20:21:37.107361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:38.717448 run osmo-stp_10.42.42.5(pid=11085): stderr: | 20221209202137298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202137298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202137298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202137298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202137299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202137299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202137299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:38.857591 run osmo-stp_10.42.42.5(pid=11085): stdout: | (launched: 2022-12-09_20:21:37.107361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:38.991040 run osmo-stp_10.42.42.5(pid=11085): stderr: | 20221209202137298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202137298 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202137298 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202137298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202137299 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202137299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202137299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:39.149633 run patchelf(pid=11088): Terminating (SIGINT) 20:21:39.331514 run patchelf(pid=11088): Terminated: ok {rc=0} 20:21:39.462810 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11085): Process ended prematurely: osmo-stp_10.42.42.5(pid=11085) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11085)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:21:39.473286 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 20:21:39.501671 run osmo-hlr_10.42.42.2(pid=11082): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11082)] 20:21:39.551601 run osmo-hlr_10.42.42.2(pid=11082): stdout: | (launched: 2022-12-09_20:21:36.090733) 20:21:39.603084 run osmo-hlr_10.42.42.2(pid=11082): stderr: | 20221209202136288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202136288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202136288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202136288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202136288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202136288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202136300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202136309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202136309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202136309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:39.655052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11075): Terminating (SIGTERM) 20:21:39.696614 run iperf3-srv_10.42.42.10(pid=11076): Terminating (SIGTERM) 20:21:39.738545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11077): Terminating (SIGTERM) 20:21:39.780059 run iperf3-srv_10.42.42.10(pid=11078): Terminating (SIGTERM) 20:21:39.821592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11081): Terminating (SIGTERM) 20:21:39.863199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11084): Terminating (SIGTERM) 20:21:39.904629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11087): Terminating (SIGTERM) 20:21:39.946362 --- ParallelTerminationStrategy: PID 11075 died... 20:21:39.966659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11075): Terminated: ok {rc=0} 20:21:40.012435 --- ParallelTerminationStrategy: PID 11076 died... 20:21:40.031798 run iperf3-srv_10.42.42.10(pid=11076): Terminated {rc=256} 20:21:40.077360 --- ParallelTerminationStrategy: PID 11077 died... 20:21:40.096608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11077): Terminated: ok {rc=0} 20:21:40.142373 --- ParallelTerminationStrategy: PID 11078 died... 20:21:40.161741 run iperf3-srv_10.42.42.10(pid=11078): Terminated {rc=256} 20:21:40.207420 --- ParallelTerminationStrategy: PID 11081 died... 20:21:40.226821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11081): Terminated: ok {rc=0} 20:21:40.272378 --- ParallelTerminationStrategy: PID 11084 died... 20:21:40.291711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11084): Terminated: ok {rc=0} 20:21:40.337368 --- ParallelTerminationStrategy: PID 11087 died... 20:21:40.356749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11087): Terminated: ok {rc=0} 20:21:40.444465 bus /gobi_0: Setting Powered False 20:21:41.543255 bus /gobi_0: Setting Powered False 20:21:42.658094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:21:43.806556 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:43.818444 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:43.881825 tst iperf3.py: using LAC 23486 20:21:44.001908 tst iperf3.py: using RAC 26 20:21:44.128313 tst iperf3.py: using CellId 23486 20:21:44.257479 tst iperf3.py: using BVCI 23487 20:21:44.371079 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.382112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.392846 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.403977 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.414986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.425825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.436816 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.447572 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:44.458769 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:44.578410 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:44.800013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:45.128269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Launched 20:21:45.412174 run iperf3-srv_10.42.42.10(pid=11090): Launched 20:21:45.534047 tst iperf3.py:8: start network... 20:21:45.754059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:46.271543 run create_hlr_db(pid=11091): Launched 20:21:46.439416 bus /gobi_6: Setting Powered False 20:21:47.500554 run create_hlr_db(pid=11091): Terminated: ok {rc=0} 20:21:47.954424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Launched 20:21:48.281854 run osmo-hlr_10.42.42.2(pid=11094): Launched 20:21:48.407346 run osmo-stp_10.42.42.5: Starting osmo-stp 20:21:48.971294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Launched 20:21:49.296642 run osmo-stp_10.42.42.5(pid=11097): Launched 20:21:49.421176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:21:49.982802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Launched 20:21:50.107718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:21:50.383016 run patchelf(pid=11100): Launched 20:21:50.564667 run osmo-stp_10.42.42.5(pid=11097): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] 20:21:50.702138 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-09_20:21:49.237218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:50.841659 run osmo-stp_10.42.42.5(pid=11097): stderr: | 20221209202149430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202149430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202149430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202149431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202149431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202149431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202149431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:50.981471 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-09_20:21:49.237218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:21:51.115024 run osmo-stp_10.42.42.5(pid=11097): stderr: | 20221209202149430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202149430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202149430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202149431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202149431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202149431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202149431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:21:51.272917 run patchelf(pid=11100): Terminating (SIGINT) 20:21:51.454789 run patchelf(pid=11100): Terminated: ok {rc=0} 20:21:51.586414 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 20:21:51.596660 tst iperf3.py:8: Test FAILED (7.8 sec) 20:21:51.625082 run osmo-hlr_10.42.42.2(pid=11094): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11094)] 20:21:51.674760 run osmo-hlr_10.42.42.2(pid=11094): stdout: | (launched: 2022-12-09_20:21:48.222285) 20:21:51.726421 run osmo-hlr_10.42.42.2(pid=11094): stderr: | 20221209202148424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202148424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202148424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202148424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202148424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202148424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202148436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202148444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202148445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202148445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:21:51.778731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Terminating (SIGTERM) 20:21:51.820120 run iperf3-srv_10.42.42.10(pid=11090): Terminating (SIGTERM) 20:21:51.861493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Terminating (SIGTERM) 20:21:51.902809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminating (SIGTERM) 20:21:51.944026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminating (SIGTERM) 20:21:51.985565 --- ParallelTerminationStrategy: PID 11089 died... 20:21:52.005305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11089): Terminated: ok {rc=0} 20:21:52.051446 --- ParallelTerminationStrategy: PID 11090 died... 20:21:52.070979 run iperf3-srv_10.42.42.10(pid=11090): Terminated {rc=256} 20:21:52.116666 --- ParallelTerminationStrategy: PID 11093 died... 20:21:52.135951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11093): Terminated: ok {rc=0} 20:21:52.181296 --- ParallelTerminationStrategy: PID 11096 died... 20:21:52.200506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminated: ok {rc=0} 20:21:52.246509 --- ParallelTerminationStrategy: PID 11099 died... 20:21:52.266022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminated: ok {rc=0} 20:21:52.353323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:21:53.504589 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:53.516479 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:21:53.578951 tst iperf3m4.py: using LAC 23487 20:21:53.706354 tst iperf3m4.py: using RAC 27 20:21:53.839445 tst iperf3m4.py: using CellId 23487 20:21:53.966698 tst iperf3m4.py: using BVCI 23488 20:21:54.084895 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.096263 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.107378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.118552 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.129677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.140782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.152021 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.163039 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:21:54.174392 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:54.295439 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:54.416276 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:54.535577 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:21:54.655182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:21:54.861655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:55.169622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Launched 20:21:55.436727 run iperf3-srv_10.42.42.10(pid=11102): Launched 20:21:55.551530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:21:55.755576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:56.061677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11103): Launched 20:21:56.326956 run iperf3-srv_10.42.42.10(pid=11104): Launched 20:21:56.443145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:21:56.647700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:56.954694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11105): Launched 20:21:57.222408 run iperf3-srv_10.42.42.10(pid=11106): Launched 20:21:57.338481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:21:57.541909 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:21:57.848193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11107): Launched 20:21:58.114201 run iperf3-srv_10.42.42.10(pid=11108): Launched 20:21:58.230244 tst iperf3m4.py:8: start network... 20:21:58.434273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:21:58.907747 run create_hlr_db(pid=11109): Launched 20:21:59.025288 bus /gobi_6: Setting Powered False 20:22:00.085931 run create_hlr_db(pid=11109): Terminated: ok {rc=0} 20:22:00.510239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11111): Launched 20:22:00.814397 run osmo-hlr_10.42.42.2(pid=11112): Launched 20:22:01.063679 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:01.715867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11114): Launched 20:22:02.061197 run osmo-stp_10.42.42.5(pid=11115): Launched 20:22:02.318272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:02.883209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11117): Launched 20:22:03.007989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:03.283327 run patchelf(pid=11118): Launched 20:22:03.465427 run osmo-stp_10.42.42.5(pid=11115): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11115)] 20:22:03.602806 run osmo-stp_10.42.42.5(pid=11115): stdout: | (launched: 2022-12-09_20:22:01.998736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:03.742372 run osmo-stp_10.42.42.5(pid=11115): stderr: | 20221209202202213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202202213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202202214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202202214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202202215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202202215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202202215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:03.882263 run osmo-stp_10.42.42.5(pid=11115): stdout: | (launched: 2022-12-09_20:22:01.998736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:04.015643 run osmo-stp_10.42.42.5(pid=11115): stderr: | 20221209202202213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202202213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202202214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202202214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202202215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202202215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202202215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:04.174115 run patchelf(pid=11118): Terminating (SIGINT) 20:22:04.355368 run patchelf(pid=11118): Terminated: ok {rc=0} 20:22:04.486081 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11115): Process ended prematurely: osmo-stp_10.42.42.5(pid=11115) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11115)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:22:04.496331 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:22:04.525119 run osmo-hlr_10.42.42.2(pid=11112): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11112)] 20:22:04.574958 run osmo-hlr_10.42.42.2(pid=11112): stdout: | (launched: 2022-12-09_20:22:00.758378) 20:22:04.626696 run osmo-hlr_10.42.42.2(pid=11112): stderr: | 20221209202201009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202201009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202201009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202201009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202201009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202201009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202201027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202201039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202201040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202201040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:04.678759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminating (SIGTERM) 20:22:04.720463 run iperf3-srv_10.42.42.10(pid=11102): Terminating (SIGTERM) 20:22:04.762841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11103): Terminating (SIGTERM) 20:22:04.804994 run iperf3-srv_10.42.42.10(pid=11104): Terminating (SIGTERM) 20:22:04.847102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11105): Terminating (SIGTERM) 20:22:04.889131 run iperf3-srv_10.42.42.10(pid=11106): Terminating (SIGTERM) 20:22:04.930937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11107): Terminating (SIGTERM) 20:22:04.973014 run iperf3-srv_10.42.42.10(pid=11108): Terminating (SIGTERM) 20:22:05.015112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11111): Terminating (SIGTERM) 20:22:05.057399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11114): Terminating (SIGTERM) 20:22:05.099278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11117): Terminating (SIGTERM) 20:22:05.141189 --- ParallelTerminationStrategy: PID 11101 died... 20:22:05.161211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminated: ok {rc=0} 20:22:05.207496 --- ParallelTerminationStrategy: PID 11102 died... 20:22:05.227045 run iperf3-srv_10.42.42.10(pid=11102): Terminated {rc=256} 20:22:05.273124 --- ParallelTerminationStrategy: PID 11103 died... 20:22:05.292766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11103): Terminated: ok {rc=0} 20:22:05.338901 --- ParallelTerminationStrategy: PID 11104 died... 20:22:05.358455 run iperf3-srv_10.42.42.10(pid=11104): Terminated {rc=256} 20:22:05.404369 --- ParallelTerminationStrategy: PID 11105 died... 20:22:05.423818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11105): Terminated: ok {rc=0} 20:22:05.469535 --- ParallelTerminationStrategy: PID 11106 died... 20:22:05.488901 run iperf3-srv_10.42.42.10(pid=11106): Terminated {rc=256} 20:22:05.534762 --- ParallelTerminationStrategy: PID 11107 died... 20:22:05.554516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11107): Terminated: ok {rc=0} 20:22:05.600599 --- ParallelTerminationStrategy: PID 11108 died... 20:22:05.620261 run iperf3-srv_10.42.42.10(pid=11108): Terminated {rc=256} 20:22:05.666222 --- ParallelTerminationStrategy: PID 11111 died... 20:22:05.685875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11111): Terminated: ok {rc=0} 20:22:05.731966 --- ParallelTerminationStrategy: PID 11114 died... 20:22:05.751953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11114): Terminated: ok {rc=0} 20:22:05.798611 --- ParallelTerminationStrategy: PID 11117 died... 20:22:05.818224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11117): Terminated: ok {rc=0} 20:22:05.906555 bus /gobi_4: Setting Powered False 20:22:07.007381 bus /gobi_4: Setting Powered False 20:22:08.124197 bus /gobi_1: Setting Powered False 20:22:09.224637 bus /gobi_1: Setting Powered False 20:22:10.341993 bus /gobi_0: Setting Powered False 20:22:11.440267 bus /gobi_0: Setting Powered False 20:22:12.556561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:22:13.660316 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:13.672352 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:22:13.735204 tst ping.py: using LAC 23488 20:22:13.855288 tst ping.py: using RAC 28 20:22:13.971741 tst ping.py: using CellId 23488 20:22:14.088377 tst ping.py: using BVCI 23489 20:22:14.197416 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.208546 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.219399 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.230578 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.241606 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.252483 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.263655 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:14.274677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:22:14.393280 tst ping.py:19: start network... 20:22:14.609411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:15.106826 run create_hlr_db(pid=11119): Launched 20:22:15.236343 bus /gobi_6: Setting Powered False 20:22:16.316640 run create_hlr_db(pid=11119): Terminated: ok {rc=0} 20:22:16.762909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11121): Launched 20:22:17.189702 run osmo-hlr_10.42.42.2(pid=11122): Launched 20:22:17.384611 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:17.938776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11124): Launched 20:22:18.259985 run osmo-stp_10.42.42.5(pid=11125): Launched 20:22:18.381582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:18.932789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11127): Launched 20:22:19.054327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:19.325575 run patchelf(pid=11128): Launched 20:22:19.503798 run osmo-stp_10.42.42.5(pid=11125): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11125)] 20:22:19.639732 run osmo-stp_10.42.42.5(pid=11125): stdout: | (launched: 2022-12-09_20:22:18.201514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:19.777529 run osmo-stp_10.42.42.5(pid=11125): stderr: | 20221209202218395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202218395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202218396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202218396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202218396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202218397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202218397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:19.914967 run osmo-stp_10.42.42.5(pid=11125): stdout: | (launched: 2022-12-09_20:22:18.201514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:20.046660 run osmo-stp_10.42.42.5(pid=11125): stderr: | 20221209202218395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202218395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202218396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202218396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202218396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202218397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202218397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:20.202137 run patchelf(pid=11128): Terminating (SIGINT) 20:22:20.381657 run patchelf(pid=11128): Terminated: ok {rc=0} 20:22:20.510867 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11125): Process ended prematurely: osmo-stp_10.42.42.5(pid=11125) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11125)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 20:22:20.520544 tst ping.py:22: Test FAILED (6.9 sec) 20:22:20.549272 run osmo-hlr_10.42.42.2(pid=11122): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11122)] 20:22:20.599624 run osmo-hlr_10.42.42.2(pid=11122): stdout: | (launched: 2022-12-09_20:22:17.117202) 20:22:20.651652 run osmo-hlr_10.42.42.2(pid=11122): stderr: | 20221209202217335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202217335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202217335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202217335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202217335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202217335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202217348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202217356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202217356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202217356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:20.703967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11121): Terminating (SIGTERM) 20:22:20.746161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11124): Terminating (SIGTERM) 20:22:20.788174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11127): Terminating (SIGTERM) 20:22:20.830579 --- ParallelTerminationStrategy: PID 11121 died... 20:22:20.850749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11121): Terminated: ok {rc=0} 20:22:20.897662 --- ParallelTerminationStrategy: PID 11124 died... 20:22:20.917705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11124): Terminated: ok {rc=0} 20:22:20.964032 --- ParallelTerminationStrategy: PID 11127 died... 20:22:20.983690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11127): Terminated: ok {rc=0} 20:22:21.071585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:22:22.160339 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.173064 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:22:22.232601 tst ping_idle_ping.py: using LAC 23489 20:22:22.351549 tst ping_idle_ping.py: using RAC 29 20:22:22.471880 tst ping_idle_ping.py: using CellId 23489 20:22:22.591648 tst ping_idle_ping.py: using BVCI 23490 20:22:22.700803 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.711846 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.722789 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.734137 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.745227 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.756140 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.767463 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:22:22.778667 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:22:22.894105 tst ping_idle_ping.py:24: start network... 20:22:23.096126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:23.570515 run create_hlr_db(pid=11129): Launched 20:22:23.687549 bus /gobi_6: Setting Powered False 20:22:24.747627 run create_hlr_db(pid=11129): Terminated: ok {rc=0} 20:22:25.189212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11131): Launched 20:22:25.512263 run osmo-hlr_10.42.42.2(pid=11132): Launched 20:22:25.635634 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:26.193447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11134): Launched 20:22:26.515008 run osmo-stp_10.42.42.5(pid=11135): Launched 20:22:26.639148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:27.195189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11137): Launched 20:22:27.319280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:27.590881 run patchelf(pid=11138): Launched 20:22:27.771057 run osmo-stp_10.42.42.5(pid=11135): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11135)] 20:22:27.907024 run osmo-stp_10.42.42.5(pid=11135): stdout: | (launched: 2022-12-09_20:22:26.455602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:28.044721 run osmo-stp_10.42.42.5(pid=11135): stderr: | 20221209202226647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202226647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202226648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202226648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202226649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202226649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202226649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:28.182626 run osmo-stp_10.42.42.5(pid=11135): stdout: | (launched: 2022-12-09_20:22:26.455602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:28.314082 run osmo-stp_10.42.42.5(pid=11135): stderr: | 20221209202226647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202226647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202226648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202226648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202226649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202226649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202226649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:28.470026 run patchelf(pid=11138): Terminating (SIGINT) 20:22:28.649530 run patchelf(pid=11138): Terminated: ok {rc=0} 20:22:28.779334 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11135): Process ended prematurely: osmo-stp_10.42.42.5(pid=11135) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11135)] [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:22:28.788922 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:22:28.817112 run osmo-hlr_10.42.42.2(pid=11132): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11132)] 20:22:28.867083 run osmo-hlr_10.42.42.2(pid=11132): stdout: | (launched: 2022-12-09_20:22:25.452838) 20:22:28.918589 run osmo-hlr_10.42.42.2(pid=11132): stderr: | 20221209202225654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202225654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202225654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202225654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202225654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202225654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202225666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202225674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202225674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202225675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:28.970706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11131): Terminating (SIGTERM) 20:22:29.012498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11134): Terminating (SIGTERM) 20:22:29.054322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11137): Terminating (SIGTERM) 20:22:29.096244 --- ParallelTerminationStrategy: PID 11131 died... 20:22:29.116112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11131): Terminated: ok {rc=0} 20:22:29.162475 --- ParallelTerminationStrategy: PID 11134 died... 20:22:29.181886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11134): Terminated: ok {rc=0} 20:22:29.228145 --- ParallelTerminationStrategy: PID 11137 died... 20:22:29.248287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11137): Terminated: ok {rc=0} 20:22:29.335203 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:22:30.619462 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:30.626390 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:22:30.647901 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:22:30.682640 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:22:30.735267 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:22:30.755670 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:22:30.790474 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:22:31.365998 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:22:31.371368 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:31.383009 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:22:31.441455 tst switch_tch_pdch.py: using LAC 23490 20:22:31.599442 tst switch_tch_pdch.py: using RAC 30 20:22:31.762457 tst switch_tch_pdch.py: using CellId 23490 20:22:31.924650 tst switch_tch_pdch.py: using BVCI 23491 20:22:32.043733 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.055613 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.067726 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.079997 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.091990 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.104683 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.117491 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:22:32.129545 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:32.252484 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:22:32.377487 tst switch_tch_pdch.py:51: start network... 20:22:32.593653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:33.091706 run create_hlr_db(pid=11143): Launched 20:22:33.222050 bus /gobi_6: Setting Powered False 20:22:34.285186 run create_hlr_db(pid=11143): Terminated: ok {rc=0} 20:22:34.730729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11145): Launched 20:22:35.053050 run osmo-hlr_10.42.42.2(pid=11146): Launched 20:22:35.176367 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:35.727459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11148): Launched 20:22:36.049981 run osmo-stp_10.42.42.5(pid=11154): Launched 20:22:36.172769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:36.725051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11156): Launched 20:22:36.847077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:37.117570 run patchelf(pid=11157): Launched 20:22:37.295974 run osmo-stp_10.42.42.5(pid=11154): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11154)] 20:22:37.432342 run osmo-stp_10.42.42.5(pid=11154): stdout: | (launched: 2022-12-09_20:22:35.991406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:37.568871 run osmo-stp_10.42.42.5(pid=11154): stderr: | 20221209202236185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202236186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202236186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202236186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202236187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202236187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202236187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:37.705497 run osmo-stp_10.42.42.5(pid=11154): stdout: | (launched: 2022-12-09_20:22:35.991406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:37.836906 run osmo-stp_10.42.42.5(pid=11154): stderr: | 20221209202236185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202236186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202236186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202236186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202236187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202236187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202236187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:37.991757 run patchelf(pid=11157): Terminating (SIGINT) 20:22:38.170217 run patchelf(pid=11157): Terminated: ok {rc=0} 20:22:38.299313 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11154): Process ended prematurely: osmo-stp_10.42.42.5(pid=11154) [trial-2364↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11154)] [trial-2364↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:22:38.308927 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 20:22:38.337201 run osmo-hlr_10.42.42.2(pid=11146): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11146)] 20:22:38.387029 run osmo-hlr_10.42.42.2(pid=11146): stdout: | (launched: 2022-12-09_20:22:34.994299) 20:22:38.438494 run osmo-hlr_10.42.42.2(pid=11146): stderr: | 20221209202235193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202235193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202235193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202235193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202235193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202235193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202235204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202235213 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202235213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202235213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:38.490343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11145): Terminating (SIGTERM) 20:22:38.531894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11148): Terminating (SIGTERM) 20:22:38.573384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11156): Terminating (SIGTERM) 20:22:38.615124 --- ParallelTerminationStrategy: PID 11145 died... 20:22:38.634530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11145): Terminated: ok {rc=0} 20:22:38.680228 --- ParallelTerminationStrategy: PID 11148 died... 20:22:38.699483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11148): Terminated: ok {rc=0} 20:22:38.745178 --- ParallelTerminationStrategy: PID 11156 died... 20:22:38.764695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11156): Terminated: ok {rc=0} 20:22:38.852125 bus /gobi_0: Setting Powered False 20:22:39.948800 bus /gobi_0: Setting Powered False 20:22:41.062856 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:22:42.296452 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:42.302176 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:22:42.322315 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:22:42.357918 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:22:42.411748 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:22:42.432901 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:22:42.467146 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:22:43.018676 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:22:43.023656 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.034497 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:22:43.094277 tst switch_tch_pdch.py: using LAC 23491 20:22:43.211636 tst switch_tch_pdch.py: using RAC 31 20:22:43.327062 tst switch_tch_pdch.py: using CellId 23491 20:22:43.442055 tst switch_tch_pdch.py: using BVCI 23492 20:22:43.550542 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.561469 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.572105 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.583049 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.593946 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.604677 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.615668 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:22:43.626475 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:22:43.745571 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:22:43.861538 tst switch_tch_pdch.py:51: start network... 20:22:44.062979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:22:44.501432 run create_hlr_db(pid=11161): Launched 20:22:44.614963 bus /gobi_6: Setting Powered False 20:22:45.674429 run create_hlr_db(pid=11161): Terminated: ok {rc=0} 20:22:46.088131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Launched 20:22:46.433104 run osmo-hlr_10.42.42.2(pid=11164): Launched 20:22:46.603305 run osmo-stp_10.42.42.5: Starting osmo-stp 20:22:47.254857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Launched 20:22:47.575254 run osmo-stp_10.42.42.5(pid=11167): Launched 20:22:47.697505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:22:48.222298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11169): Launched 20:22:48.343424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:22:48.613689 run patchelf(pid=11170): Launched 20:22:48.792286 run osmo-stp_10.42.42.5(pid=11167): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] 20:22:48.927731 run osmo-stp_10.42.42.5(pid=11167): stdout: | (launched: 2022-12-09_20:22:47.516763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:49.064821 run osmo-stp_10.42.42.5(pid=11167): stderr: | 20221209202247709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202247709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202247709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202247709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202247710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202247710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202247710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:49.201494 run osmo-stp_10.42.42.5(pid=11167): stdout: | (launched: 2022-12-09_20:22:47.516763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:22:49.332566 run osmo-stp_10.42.42.5(pid=11167): stderr: | 20221209202247709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202247709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202247709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202247709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202247710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202247710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202247710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:22:49.488517 run patchelf(pid=11170): Terminating (SIGINT) 20:22:49.666997 run patchelf(pid=11170): Terminated: ok {rc=0} 20:22:49.796032 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11167): Process ended prematurely: osmo-stp_10.42.42.5(pid=11167) [trial-2364↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] [trial-2364↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:22:49.805742 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 20:22:49.833827 run osmo-hlr_10.42.42.2(pid=11164): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11164)] 20:22:49.883816 run osmo-hlr_10.42.42.2(pid=11164): stdout: | (launched: 2022-12-09_20:22:46.370489) 20:22:49.935430 run osmo-hlr_10.42.42.2(pid=11164): stderr: | 20221209202246726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202246726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202246726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202246726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202246726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202246726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202246745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202246753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202246753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202246753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:22:49.987365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Terminating (SIGTERM) 20:22:50.029503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Terminating (SIGTERM) 20:22:50.071185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11169): Terminating (SIGTERM) 20:22:50.113177 --- ParallelTerminationStrategy: PID 11163 died... 20:22:50.132927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11163): Terminated: ok {rc=0} 20:22:50.179142 --- ParallelTerminationStrategy: PID 11166 died... 20:22:50.198647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11166): Terminated: ok {rc=0} 20:22:50.244906 --- ParallelTerminationStrategy: PID 11169 died... 20:22:50.264759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11169): Terminated: ok {rc=0} 20:22:50.352831 bus /gobi_0: Setting Powered False 20:22:51.450324 bus /gobi_0: Setting Powered False 20:22:52.566529 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:trx-b200 --------------------------------------------------------------------- 20:22:53.805155 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:22:53.809354 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:22:53.843268 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:22:53.850217 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:22:53.903080 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:22:53.937050 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:22:53.943951 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:22:54.483990 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:22:54.489206 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 20:22:54.500169 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 20:22:54.549468 tst mo_mt_sms.py: using LAC 23492 20:22:54.675220 tst mo_mt_sms.py: using RAC 32 20:22:54.802316 tst mo_mt_sms.py: using CellId 23492 20:22:54.929558 tst mo_mt_sms.py: using BVCI 23493 20:22:55.046612 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:55.160876 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 20:22:55.280399 tst mo_mt_sms.py:9: start nitb and bts... 20:22:55.497566 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:22:56.150121 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11174): Launched 20:22:56.472560 run osmo-nitb_10.42.42.2(pid=11175): Launched 20:22:56.650946 run osmo-nitb_10.42.42.2(pid=11175): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11175)] 20:22:56.794772 run osmo-nitb_10.42.42.2(pid=11175): stdout: | (launched: 2022-12-09_20:22:56.413987) 20:22:56.939496 run osmo-nitb_10.42.42.2(pid=11175): stderr: | (launched: 2022-12-09_20:22:56.461802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:22:57.084407 run osmo-nitb_10.42.42.2(pid=11175): stdout: | (launched: 2022-12-09_20:22:56.413987) 20:22:57.223715 run osmo-nitb_10.42.42.2(pid=11175): stderr: | (launched: 2022-12-09_20:22:56.461802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11175): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11175) [trial-2364↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11175)] 20:22:57.594256 tst osmo-nitb_10.42.42.2(pid=11175): stdout: | (launched: 2022-12-09_20:22:56.413987) 20:22:57.724248 tst osmo-nitb_10.42.42.2(pid=11175): stderr: | (launched: 2022-12-09_20:22:56.461802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:22:57.878207 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11175): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11175) [trial-2364↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11175)] [trial-2364↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 20:22:57.887793 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:22:57.895265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11174): Terminating (SIGTERM) 20:22:58.106396 --- ParallelTerminationStrategy: PID 11174 died... 20:22:58.128097 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11174): Terminated: ok {rc=0} 20:22:58.216910 bus /sierra_3: Setting Powered False 20:22:59.318687 bus /sierra_3: Setting Powered False 20:23:00.435678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:trx-b200 --------------------------------------------------------------------- 20:23:01.659097 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:01.664502 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 20:23:01.702896 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:23:01.731691 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 20:23:01.791568 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 20:23:01.845463 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:23:01.876118 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 20:23:02.398748 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 20:23:02.405382 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:02.416672 tst sms:trx-b200: Using 1 x bts (candidates: 1) 20:23:02.474406 tst mo_mt_sms.py: using LAC 23493 20:23:02.596526 tst mo_mt_sms.py: using RAC 33 20:23:02.716390 tst mo_mt_sms.py: using CellId 23493 20:23:02.834187 tst mo_mt_sms.py: using BVCI 23494 20:23:02.945386 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:02.957682 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:02.969040 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:02.981385 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:02.995042 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:03.006278 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:23:03.126321 tst sms:trx-b200: Using 1 x modem (candidates: 2) 20:23:03.244337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:03.724446 run create_hlr_db(pid=11190): Launched 20:23:03.888127 bus /sierra_2: Setting Powered False 20:23:04.952353 run create_hlr_db(pid=11190): Terminated: ok {rc=0} 20:23:05.398460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Launched 20:23:05.718665 run osmo-hlr_10.42.42.2(pid=11195): Launched 20:23:05.963917 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:06.620415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Launched 20:23:06.973300 run osmo-stp_10.42.42.5(pid=11199): Launched 20:23:07.243481 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:07.938652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11258): Launched 20:23:08.333423 run osmo-msc_10.42.42.6(pid=11304): Launched 20:23:08.764720 run osmo-stp_10.42.42.5(pid=11199): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] 20:23:09.049234 run osmo-stp_10.42.42.5(pid=11199): stdout: | (launched: 2022-12-09_20:23:06.898573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:09.303794 run osmo-stp_10.42.42.5(pid=11199): stderr: | 20221209202307233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202307233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202307234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202307234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202307234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202307235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202307235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:09.471909 run osmo-stp_10.42.42.5(pid=11199): stdout: | (launched: 2022-12-09_20:23:06.898573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:09.620444 run osmo-stp_10.42.42.5(pid=11199): stderr: | 20221209202307233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202307233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202307234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202307234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202307234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202307235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202307235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:09.797749 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11199): Process ended prematurely: osmo-stp_10.42.42.5(pid=11199) [trial-2364↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] [trial-2364↪sms:trx-b200↪mo_mt_sms.py:16] 20:23:09.807351 tst mo_mt_sms.py:16: Test FAILED (7.4 sec) 20:23:09.835598 run osmo-hlr_10.42.42.2(pid=11195): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11195)] 20:23:09.891549 run osmo-hlr_10.42.42.2(pid=11195): stdout: | (launched: 2022-12-09_20:23:05.662955) 20:23:09.946454 run osmo-hlr_10.42.42.2(pid=11195): stderr: | 20221209202305961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202305961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202305961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202305961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202305961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202305962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202305987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202305997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202305998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202305998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:10.020581 run osmo-msc_10.42.42.6(pid=11304): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11304)] 20:23:10.071960 run osmo-msc_10.42.42.6(pid=11304): stdout: | (launched: 2022-12-09_20:23:08.267582) 20:23:10.124858 run osmo-msc_10.42.42.6(pid=11304): stderr: | 20221209202308846 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202308846 DLGLOBAL DEBUG validating counter group 0x7fc7552c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202308846 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202308846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202308846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202308846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202308848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202308848 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202308857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202308857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:10.177933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Terminating (SIGTERM) 20:23:10.221635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Terminating (SIGTERM) 20:23:10.266718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11258): Terminating (SIGTERM) 20:23:10.312215 --- ParallelTerminationStrategy: PID 11193 died... 20:23:10.332440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11193): Terminated: ok {rc=0} 20:23:10.382202 --- ParallelTerminationStrategy: PID 11197 died... 20:23:10.402011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Terminated: ok {rc=0} 20:23:10.449809 --- ParallelTerminationStrategy: PID 11258 died... 20:23:10.469928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11258): Terminated: ok {rc=0} 20:23:10.558801 bus /sierra_3: Setting Powered False 20:23:11.658642 bus /sierra_3: Setting Powered False 20:23:12.777135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-b200 --------------------------------------------------------------------- 20:23:14.013825 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:14.018409 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:23:14.055291 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 20:23:14.063003 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:23:14.097347 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:23:14.132813 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 20:23:14.140578 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:23:14.658716 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:23:14.665721 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 20:23:14.677900 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 20:23:14.729383 tst assert_extension.py: using LAC 23494 20:23:14.850503 tst assert_extension.py: using RAC 34 20:23:14.971217 tst assert_extension.py: using CellId 23494 20:23:15.091294 tst assert_extension.py: using BVCI 23495 20:23:15.206257 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 20:23:15.326586 tst assert_extension.py:10: start nitb and bts... 20:23:15.536377 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:23:16.222729 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11464): Launched 20:23:16.543694 run osmo-nitb_10.42.42.2(pid=11465): Launched 20:23:16.737395 run osmo-nitb_10.42.42.2(pid=11465): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11465)] 20:23:16.877759 run osmo-nitb_10.42.42.2(pid=11465): stdout: | (launched: 2022-12-09_20:23:16.486296) 20:23:17.020013 run osmo-nitb_10.42.42.2(pid=11465): stderr: | (launched: 2022-12-09_20:23:16.532536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:17.161019 run osmo-nitb_10.42.42.2(pid=11465): stdout: | (launched: 2022-12-09_20:23:16.486296) 20:23:17.298255 run osmo-nitb_10.42.42.2(pid=11465): stderr: | (launched: 2022-12-09_20:23:16.532536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11465) [trial-2364↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11465)] 20:23:17.682881 tst osmo-nitb_10.42.42.2(pid=11465): stdout: | (launched: 2022-12-09_20:23:16.486296) 20:23:17.822193 tst osmo-nitb_10.42.42.2(pid=11465): stderr: | (launched: 2022-12-09_20:23:16.532536) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:23:17.971512 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11465) [trial-2364↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11465)] [trial-2364↪nitb_ussd:trx-b200↪assert_extension.py:12] 20:23:17.981077 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:23:17.988823 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11464): Terminating (SIGTERM) 20:23:18.202097 --- ParallelTerminationStrategy: PID 11464 died... 20:23:18.226724 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11464): Terminated: ok {rc=0} 20:23:18.328321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:trx-b200 --------------------------------------------------------------------- 20:23:19.509207 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:19.514017 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 20:23:19.552261 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:23:19.582459 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 20:23:19.617723 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 20:23:19.652755 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:23:19.682639 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 20:23:20.207331 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:trx-b200 assert_extension.py ---------------------------------------------- 20:23:20.213981 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.225637 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 20:23:20.277624 tst assert_extension.py: using LAC 23495 20:23:20.399705 tst assert_extension.py: using RAC 35 20:23:20.522338 tst assert_extension.py: using CellId 23495 20:23:20.646916 tst assert_extension.py: using BVCI 23496 20:23:20.760376 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.773305 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.784804 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.797694 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.810128 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 20:23:20.822372 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 20:23:20.942921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:21.427699 run create_hlr_db(pid=11469): Launched 20:23:21.591745 bus /sierra_2: Setting Powered False 20:23:22.652318 run create_hlr_db(pid=11469): Terminated: ok {rc=0} 20:23:23.091867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Launched 20:23:23.418066 run osmo-hlr_10.42.42.2(pid=11472): Launched 20:23:23.660932 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:24.402436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Launched 20:23:24.730845 run osmo-stp_10.42.42.5(pid=11475): Launched 20:23:24.973868 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:25.693502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11478): Launched 20:23:26.015612 run osmo-msc_10.42.42.6(pid=11479): Launched 20:23:26.195268 run osmo-stp_10.42.42.5(pid=11475): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] 20:23:26.334950 run osmo-stp_10.42.42.5(pid=11475): stdout: | (launched: 2022-12-09_20:23:24.672676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:26.470290 run osmo-stp_10.42.42.5(pid=11475): stderr: | 20221209202325010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202325010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202325010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202325011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202325013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202325014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202325014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:26.603909 run osmo-stp_10.42.42.5(pid=11475): stdout: | (launched: 2022-12-09_20:23:24.672676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:26.731706 run osmo-stp_10.42.42.5(pid=11475): stderr: | 20221209202325010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202325010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202325010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202325011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202325013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202325014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202325014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:26.885051 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11475): Process ended prematurely: osmo-stp_10.42.42.5(pid=11475) [trial-2364↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] [trial-2364↪ussd:trx-b200↪assert_extension.py:17] 20:23:26.894052 tst assert_extension.py:17: Test FAILED (6.7 sec) 20:23:26.921528 run osmo-hlr_10.42.42.2(pid=11472): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11472)] 20:23:26.972127 run osmo-hlr_10.42.42.2(pid=11472): stdout: | (launched: 2022-12-09_20:23:23.359529) 20:23:27.024260 run osmo-hlr_10.42.42.2(pid=11472): stderr: | 20221209202323722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202323722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202323722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202323722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202323722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202323722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202323734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202323747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202323748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202323748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:27.096914 run osmo-msc_10.42.42.6(pid=11479): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11479)] 20:23:27.147533 run osmo-msc_10.42.42.6(pid=11479): stdout: | (launched: 2022-12-09_20:23:25.956780) 20:23:27.199797 run osmo-msc_10.42.42.6(pid=11479): stderr: | 20221209202326280 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202326280 DLGLOBAL DEBUG validating counter group 0x7f2c0d32ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202326280 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202326280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202326280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202326281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202326282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202326283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202326283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202326283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:27.252400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Terminating (SIGTERM) 20:23:27.294126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Terminating (SIGTERM) 20:23:27.336007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11478): Terminating (SIGTERM) 20:23:27.378224 --- ParallelTerminationStrategy: PID 11471 died... 20:23:27.398366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11471): Terminated: ok {rc=0} 20:23:27.444847 --- ParallelTerminationStrategy: PID 11474 died... 20:23:27.464843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11474): Terminated: ok {rc=0} 20:23:27.511372 --- ParallelTerminationStrategy: PID 11478 died... 20:23:27.531022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11478): Terminated: ok {rc=0} 20:23:27.619226 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:23:28.837590 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:28.845078 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:23:28.879014 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:23:28.906165 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:23:28.962489 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:23:28.996496 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:23:29.023497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:23:29.570813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:23:29.623721 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:29.635276 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:23:29.704560 tst mo_mt_call.py: using LAC 23496 20:23:29.831340 tst mo_mt_call.py: using RAC 36 20:23:29.960771 tst mo_mt_call.py: using CellId 23496 20:23:30.080695 tst mo_mt_call.py: using BVCI 23497 20:23:30.191982 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:30.203206 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:30.214667 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:30.226178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:30.237734 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:30.248938 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:30.368230 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:30.489365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:31.021524 run create_hlr_db(pid=11484): Launched 20:23:31.182112 bus /sierra_2: Setting Powered False 20:23:32.248235 run create_hlr_db(pid=11484): Terminated: ok {rc=0} 20:23:32.709556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11486): Launched 20:23:33.037189 run osmo-hlr_10.42.42.2(pid=11487): Launched 20:23:33.163317 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:33.728732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11489): Launched 20:23:34.056560 run osmo-stp_10.42.42.5(pid=11490): Launched 20:23:34.182603 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:34.777734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11492): Launched 20:23:35.106368 run osmo-msc_10.42.42.6(pid=11493): Launched 20:23:35.290174 run osmo-stp_10.42.42.5(pid=11490): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11490)] 20:23:35.427982 run osmo-stp_10.42.42.5(pid=11490): stdout: | (launched: 2022-12-09_20:23:33.996307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:35.565678 run osmo-stp_10.42.42.5(pid=11490): stderr: | 20221209202334190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202334191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202334191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202334191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202334194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202334194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202334194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:35.702816 run osmo-stp_10.42.42.5(pid=11490): stdout: | (launched: 2022-12-09_20:23:33.996307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:35.834673 run osmo-stp_10.42.42.5(pid=11490): stderr: | 20221209202334190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202334191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202334191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202334191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202334194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202334194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202334194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:35.990785 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11490): Process ended prematurely: osmo-stp_10.42.42.5(pid=11490) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11490)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:23:36.000344 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:23:36.028103 run osmo-hlr_10.42.42.2(pid=11487): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11487)] 20:23:36.078191 run osmo-hlr_10.42.42.2(pid=11487): stdout: | (launched: 2022-12-09_20:23:32.977354) 20:23:36.130075 run osmo-hlr_10.42.42.2(pid=11487): stderr: | 20221209202333180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202333180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202333180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202333180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202333180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202333180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202333192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202333200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202333201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202333201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:36.202301 run osmo-msc_10.42.42.6(pid=11493): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11493)] 20:23:36.252427 run osmo-msc_10.42.42.6(pid=11493): stdout: | (launched: 2022-12-09_20:23:35.045901) 20:23:36.304165 run osmo-msc_10.42.42.6(pid=11493): stderr: | 20221209202335370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202335371 DLGLOBAL DEBUG validating counter group 0x7f8728bcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202335371 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202335371 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202335371 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202335371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202335373 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202335373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202335373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202335373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:36.356581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11486): Terminating (SIGTERM) 20:23:36.398208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11489): Terminating (SIGTERM) 20:23:36.439782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11492): Terminating (SIGTERM) 20:23:36.481612 --- ParallelTerminationStrategy: PID 11486 died... 20:23:36.501468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11486): Terminated: ok {rc=0} 20:23:36.547526 --- ParallelTerminationStrategy: PID 11489 died... 20:23:36.567043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11489): Terminated: ok {rc=0} 20:23:36.613540 --- ParallelTerminationStrategy: PID 11492 died... 20:23:36.633159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11492): Terminated: ok {rc=0} 20:23:36.721435 bus /sierra_3: Setting Powered False 20:23:37.820429 bus /sierra_3: Setting Powered False 20:23:38.938191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:23:40.087726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.099945 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:23:40.171395 tst mo_mt_call_osmux.py: using LAC 23497 20:23:40.292427 tst mo_mt_call_osmux.py: using RAC 37 20:23:40.417025 tst mo_mt_call_osmux.py: using CellId 23497 20:23:40.537361 tst mo_mt_call_osmux.py: using BVCI 23498 20:23:40.648552 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.659664 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.670593 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.681930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.693003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:23:40.704057 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:40.824218 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:23:40.941148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:41.415841 run create_hlr_db(pid=11495): Launched 20:23:41.533081 bus /sierra_2: Setting Powered False 20:23:42.593718 run create_hlr_db(pid=11495): Terminated: ok {rc=0} 20:23:43.020128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Launched 20:23:43.327032 run osmo-hlr_10.42.42.2(pid=11498): Launched 20:23:43.444282 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:43.977010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Launched 20:23:44.285136 run osmo-stp_10.42.42.5(pid=11501): Launched 20:23:44.402793 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:44.956037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11503): Launched 20:23:45.261478 run osmo-msc_10.42.42.6(pid=11504): Launched 20:23:45.432358 run osmo-stp_10.42.42.5(pid=11501): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] 20:23:45.562058 run osmo-stp_10.42.42.5(pid=11501): stdout: | (launched: 2022-12-09_20:23:44.228546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:45.691413 run osmo-stp_10.42.42.5(pid=11501): stderr: | 20221209202344401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202344401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202344402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202344402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202344402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202344403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202344403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:45.818884 run osmo-stp_10.42.42.5(pid=11501): stdout: | (launched: 2022-12-09_20:23:44.228546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:45.977287 run osmo-stp_10.42.42.5(pid=11501): stderr: | 20221209202344401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202344401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202344402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202344402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202344402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202344403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202344403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:46.138216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11501): Process ended prematurely: osmo-stp_10.42.42.5(pid=11501) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:23:46.148918 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:23:46.179348 run osmo-hlr_10.42.42.2(pid=11498): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11498)] 20:23:46.231396 run osmo-hlr_10.42.42.2(pid=11498): stdout: | (launched: 2022-12-09_20:23:43.269931) 20:23:46.284889 run osmo-hlr_10.42.42.2(pid=11498): stderr: | 20221209202343446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202343446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202343446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202343446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202343446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202343446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202343462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202343472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202343472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202343473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:46.359515 run osmo-msc_10.42.42.6(pid=11504): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11504)] 20:23:46.412283 run osmo-msc_10.42.42.6(pid=11504): stdout: | (launched: 2022-12-09_20:23:45.204919) 20:23:46.465387 run osmo-msc_10.42.42.6(pid=11504): stderr: | 20221209202345480 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202345480 DLGLOBAL DEBUG validating counter group 0x7f5f3907ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202345481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202345481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202345481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202345481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202345483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202345484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202345484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202345484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:46.519310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Terminating (SIGTERM) 20:23:46.563099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Terminating (SIGTERM) 20:23:46.610382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11503): Terminating (SIGTERM) 20:23:46.655333 --- ParallelTerminationStrategy: PID 11497 died... 20:23:46.676393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11497): Terminated: ok {rc=0} 20:23:46.725688 --- ParallelTerminationStrategy: PID 11500 died... 20:23:46.746316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11500): Terminated: ok {rc=0} 20:23:46.795494 --- ParallelTerminationStrategy: PID 11503 died... 20:23:46.815971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11503): Terminated: ok {rc=0} 20:23:46.906598 bus /sierra_3: Setting Powered False 20:23:48.007713 bus /sierra_3: Setting Powered False 20:23:49.125583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:23:50.373277 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:23:50.379722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:23:50.413725 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:23:50.439795 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:23:50.491121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:23:50.524054 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:23:50.550490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:23:51.101138 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:23:51.150403 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.161448 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:23:51.230017 tst mo_mt_call.py: using LAC 23498 20:23:51.351619 tst mo_mt_call.py: using RAC 38 20:23:51.472674 tst mo_mt_call.py: using CellId 23498 20:23:51.597761 tst mo_mt_call.py: using BVCI 23499 20:23:51.719032 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.730868 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.742408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.754489 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.766708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:23:51.781765 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:51.902402 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:23:52.019809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:23:52.494821 run create_hlr_db(pid=11509): Launched 20:23:52.612292 bus /sierra_2: Setting Powered False 20:23:53.673221 run create_hlr_db(pid=11509): Terminated: ok {rc=0} 20:23:54.099884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11511): Launched 20:23:54.406693 run osmo-hlr_10.42.42.2(pid=11512): Launched 20:23:54.523193 run osmo-stp_10.42.42.5: Starting osmo-stp 20:23:55.065962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11514): Launched 20:23:55.372919 run osmo-stp_10.42.42.5(pid=11515): Launched 20:23:55.490700 run osmo-msc_10.42.42.6: Starting osmo-msc 20:23:56.080274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11517): Launched 20:23:56.407788 run osmo-msc_10.42.42.6(pid=11518): Launched 20:23:56.589758 run osmo-stp_10.42.42.5(pid=11515): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11515)] 20:23:56.726361 run osmo-stp_10.42.42.5(pid=11515): stdout: | (launched: 2022-12-09_20:23:55.316384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:56.864214 run osmo-stp_10.42.42.5(pid=11515): stderr: | 20221209202355487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202355487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202355487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202355488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202355488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202355488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202355488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:57.000750 run osmo-stp_10.42.42.5(pid=11515): stdout: | (launched: 2022-12-09_20:23:55.316384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:23:57.131165 run osmo-stp_10.42.42.5(pid=11515): stderr: | 20221209202355487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202355487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202355487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202355488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202355488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202355488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202355488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:23:57.286631 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11515): Process ended prematurely: osmo-stp_10.42.42.5(pid=11515) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11515)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:23:57.296425 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:23:57.324553 run osmo-hlr_10.42.42.2(pid=11512): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11512)] 20:23:57.374470 run osmo-hlr_10.42.42.2(pid=11512): stdout: | (launched: 2022-12-09_20:23:54.350102) 20:23:57.426204 run osmo-hlr_10.42.42.2(pid=11512): stderr: | 20221209202354526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202354526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202354526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202354526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202354526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202354526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202354538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202354547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202354547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202354547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:23:57.498149 run osmo-msc_10.42.42.6(pid=11518): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11518)] 20:23:57.548056 run osmo-msc_10.42.42.6(pid=11518): stdout: | (launched: 2022-12-09_20:23:56.347553) 20:23:57.599499 run osmo-msc_10.42.42.6(pid=11518): stderr: | 20221209202356674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202356674 DLGLOBAL DEBUG validating counter group 0x7f2e16856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202356674 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202356674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202356674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202356674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202356676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202356676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202356677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202356677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:23:57.651452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11511): Terminating (SIGTERM) 20:23:57.693753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11514): Terminating (SIGTERM) 20:23:57.735854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11517): Terminating (SIGTERM) 20:23:57.777664 --- ParallelTerminationStrategy: PID 11511 died... 20:23:57.797947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11511): Terminated: ok {rc=0} 20:23:57.844402 --- ParallelTerminationStrategy: PID 11514 died... 20:23:57.863984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11514): Terminated: ok {rc=0} 20:23:57.910714 --- ParallelTerminationStrategy: PID 11517 died... 20:23:57.930426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11517): Terminated: ok {rc=0} 20:23:58.018859 bus /sierra_3: Setting Powered False 20:23:59.118637 bus /sierra_3: Setting Powered False 20:24:00.238317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:24:01.391978 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:01.405300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:24:01.478482 tst mo_mt_call_osmux.py: using LAC 23499 20:24:01.637449 tst mo_mt_call_osmux.py: using RAC 39 20:24:01.766894 tst mo_mt_call_osmux.py: using CellId 23499 20:24:01.929495 tst mo_mt_call_osmux.py: using BVCI 23500 20:24:02.053209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:02.065968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:02.078373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:02.090461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:02.102501 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:24:02.114648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:24:02.239268 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:24:02.366032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:02.845696 run create_hlr_db(pid=11520): Launched 20:24:02.963179 bus /sierra_2: Setting Powered False 20:24:04.025113 run create_hlr_db(pid=11520): Terminated: ok {rc=0} 20:24:04.453597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Launched 20:24:04.762564 run osmo-hlr_10.42.42.2(pid=11523): Launched 20:24:04.879510 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:05.406179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Launched 20:24:05.713579 run osmo-stp_10.42.42.5(pid=11526): Launched 20:24:05.830961 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:06.392107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11528): Launched 20:24:06.699483 run osmo-msc_10.42.42.6(pid=11529): Launched 20:24:06.870887 run osmo-stp_10.42.42.5(pid=11526): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] 20:24:07.001064 run osmo-stp_10.42.42.5(pid=11526): stdout: | (launched: 2022-12-09_20:24:05.656573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:07.131135 run osmo-stp_10.42.42.5(pid=11526): stderr: | 20221209202405830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202405830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202405831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202405831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202405832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202405832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202405832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:07.259259 run osmo-stp_10.42.42.5(pid=11526): stdout: | (launched: 2022-12-09_20:24:05.656573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:07.381752 run osmo-stp_10.42.42.5(pid=11526): stderr: | 20221209202405830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202405830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202405831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202405831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202405832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202405832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202405832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:07.528090 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11526): Process ended prematurely: osmo-stp_10.42.42.5(pid=11526) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:24:07.537458 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:24:07.564871 run osmo-hlr_10.42.42.2(pid=11523): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11523)] 20:24:07.613281 run osmo-hlr_10.42.42.2(pid=11523): stdout: | (launched: 2022-12-09_20:24:04.705714) 20:24:07.663138 run osmo-hlr_10.42.42.2(pid=11523): stderr: | 20221209202404885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202404885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202404885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202404885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202404885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202404885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202404897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202404906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202404906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202404906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:07.732561 run osmo-msc_10.42.42.6(pid=11529): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11529)] 20:24:07.780831 run osmo-msc_10.42.42.6(pid=11529): stdout: | (launched: 2022-12-09_20:24:06.643097) 20:24:07.830738 run osmo-msc_10.42.42.6(pid=11529): stderr: | 20221209202406914 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202406914 DLGLOBAL DEBUG validating counter group 0x7fd03fd44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202406914 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202406914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202406914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202406914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202406916 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202406916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202406917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202406917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:07.881086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Terminating (SIGTERM) 20:24:07.921128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Terminating (SIGTERM) 20:24:07.961291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11528): Terminating (SIGTERM) 20:24:08.002308 --- ParallelTerminationStrategy: PID 11522 died... 20:24:08.021288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11522): Terminated: ok {rc=0} 20:24:08.065986 --- ParallelTerminationStrategy: PID 11525 died... 20:24:08.084525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11525): Terminated: ok {rc=0} 20:24:08.129100 --- ParallelTerminationStrategy: PID 11528 died... 20:24:08.147572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11528): Terminated: ok {rc=0} 20:24:08.233500 bus /sierra_3: Setting Powered False 20:24:09.336275 bus /sierra_3: Setting Powered False 20:24:10.454166 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:24:11.702166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:11.708600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:24:11.742433 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:24:11.768896 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:24:11.822101 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:24:11.855569 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:24:11.882410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:24:12.430275 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:24:12.485180 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:12.496750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:24:12.569506 tst mo_mt_call.py: using LAC 23500 20:24:12.699534 tst mo_mt_call.py: using RAC 40 20:24:12.829234 tst mo_mt_call.py: using CellId 23500 20:24:12.958411 tst mo_mt_call.py: using BVCI 23501 20:24:13.076624 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:13.088112 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:13.099502 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:13.110816 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:13.122283 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:13.133717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:13.252732 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:13.370510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:13.845335 run create_hlr_db(pid=11534): Launched 20:24:13.963315 bus /sierra_2: Setting Powered False 20:24:15.023927 run create_hlr_db(pid=11534): Terminated: ok {rc=0} 20:24:15.450642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11536): Launched 20:24:15.756357 run osmo-hlr_10.42.42.2(pid=11537): Launched 20:24:15.924725 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:16.588369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11539): Launched 20:24:16.935751 run osmo-stp_10.42.42.5(pid=11540): Launched 20:24:17.213631 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:17.851947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11542): Launched 20:24:18.179424 run osmo-msc_10.42.42.6(pid=11543): Launched 20:24:18.361247 run osmo-stp_10.42.42.5(pid=11540): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11540)] 20:24:18.499729 run osmo-stp_10.42.42.5(pid=11540): stdout: | (launched: 2022-12-09_20:24:16.874996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:18.638751 run osmo-stp_10.42.42.5(pid=11540): stderr: | 20221209202417183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202417183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202417183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202417184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202417184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202417184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202417184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:18.776120 run osmo-stp_10.42.42.5(pid=11540): stdout: | (launched: 2022-12-09_20:24:16.874996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:18.907708 run osmo-stp_10.42.42.5(pid=11540): stderr: | 20221209202417183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202417183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202417183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202417184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202417184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202417184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202417184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:19.064025 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11540): Process ended prematurely: osmo-stp_10.42.42.5(pid=11540) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11540)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:24:19.074065 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:24:19.102014 run osmo-hlr_10.42.42.2(pid=11537): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11537)] 20:24:19.152291 run osmo-hlr_10.42.42.2(pid=11537): stdout: | (launched: 2022-12-09_20:24:15.700140) 20:24:19.204360 run osmo-hlr_10.42.42.2(pid=11537): stderr: | 20221209202415879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202415879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202415879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202415879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202415879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202415879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202415898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202415908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202415913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202415913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:19.276513 run osmo-msc_10.42.42.6(pid=11543): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11543)] 20:24:19.326825 run osmo-msc_10.42.42.6(pid=11543): stdout: | (launched: 2022-12-09_20:24:18.119484) 20:24:19.379056 run osmo-msc_10.42.42.6(pid=11543): stderr: | 20221209202418442 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202418442 DLGLOBAL DEBUG validating counter group 0x7faafa8b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202418442 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202418442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202418442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202418443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202418444 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202418445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202418445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202418445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:19.431288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11536): Terminating (SIGTERM) 20:24:19.472898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11539): Terminating (SIGTERM) 20:24:19.514713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11542): Terminating (SIGTERM) 20:24:19.556614 --- ParallelTerminationStrategy: PID 11536 died... 20:24:19.576602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11536): Terminated: ok {rc=0} 20:24:19.622911 --- ParallelTerminationStrategy: PID 11539 died... 20:24:19.642473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11539): Terminated: ok {rc=0} 20:24:19.688872 --- ParallelTerminationStrategy: PID 11542 died... 20:24:19.708822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11542): Terminated: ok {rc=0} 20:24:19.798678 bus /sierra_3: Setting Powered False 20:24:20.898746 bus /sierra_3: Setting Powered False 20:24:22.015220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:24:23.162870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.174753 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:24:23.244719 tst mo_mt_call_osmux.py: using LAC 23501 20:24:23.365335 tst mo_mt_call_osmux.py: using RAC 41 20:24:23.486460 tst mo_mt_call_osmux.py: using CellId 23501 20:24:23.611974 tst mo_mt_call_osmux.py: using BVCI 23502 20:24:23.725944 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.737225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.748086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.759504 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.770922 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:24:23.782330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:23.899615 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:24:24.022031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:24.531258 run create_hlr_db(pid=11545): Launched 20:24:24.664135 bus /sierra_2: Setting Powered False 20:24:25.728908 run create_hlr_db(pid=11545): Terminated: ok {rc=0} 20:24:26.168510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11547): Launched 20:24:26.475752 run osmo-hlr_10.42.42.2(pid=11548): Launched 20:24:26.594401 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:27.137648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11550): Launched 20:24:27.444214 run osmo-stp_10.42.42.5(pid=11551): Launched 20:24:27.562818 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:28.117710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11553): Launched 20:24:28.426037 run osmo-msc_10.42.42.6(pid=11554): Launched 20:24:28.598477 run osmo-stp_10.42.42.5(pid=11551): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11551)] 20:24:28.728153 run osmo-stp_10.42.42.5(pid=11551): stdout: | (launched: 2022-12-09_20:24:27.387775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:28.858322 run osmo-stp_10.42.42.5(pid=11551): stderr: | 20221209202427562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202427562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202427562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202427563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202427563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202427563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202427563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:28.986445 run osmo-stp_10.42.42.5(pid=11551): stdout: | (launched: 2022-12-09_20:24:27.387775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:29.109196 run osmo-stp_10.42.42.5(pid=11551): stderr: | 20221209202427562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202427562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202427562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202427563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202427563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202427563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202427563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:29.255657 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11551): Process ended prematurely: osmo-stp_10.42.42.5(pid=11551) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11551)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:24:29.264869 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:24:29.292334 run osmo-hlr_10.42.42.2(pid=11548): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11548)] 20:24:29.340705 run osmo-hlr_10.42.42.2(pid=11548): stdout: | (launched: 2022-12-09_20:24:26.419177) 20:24:29.390941 run osmo-hlr_10.42.42.2(pid=11548): stderr: | 20221209202426598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202426598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202426598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202426598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202426598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202426598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202426611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202426619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202426620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202426620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:29.460879 run osmo-msc_10.42.42.6(pid=11554): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11554)] 20:24:29.509376 run osmo-msc_10.42.42.6(pid=11554): stdout: | (launched: 2022-12-09_20:24:28.369394) 20:24:29.559412 run osmo-msc_10.42.42.6(pid=11554): stderr: | 20221209202428644 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202428644 DLGLOBAL DEBUG validating counter group 0x7effbb06dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202428644 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202428644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202428645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202428645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202428647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202428647 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202428647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202428647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:29.610029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11547): Terminating (SIGTERM) 20:24:29.650394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11550): Terminating (SIGTERM) 20:24:29.690722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11553): Terminating (SIGTERM) 20:24:29.731234 --- ParallelTerminationStrategy: PID 11547 died... 20:24:29.750605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11547): Terminated: ok {rc=0} 20:24:29.795723 --- ParallelTerminationStrategy: PID 11550 died... 20:24:29.814555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11550): Terminated: ok {rc=0} 20:24:29.859008 --- ParallelTerminationStrategy: PID 11553 died... 20:24:29.877767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11553): Terminated: ok {rc=0} 20:24:29.961879 bus /sierra_3: Setting Powered False 20:24:31.057824 bus /sierra_3: Setting Powered False 20:24:32.178604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:24:33.438072 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:33.444996 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:24:33.478845 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:24:33.506151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:24:33.559190 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:24:33.593143 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:24:33.620545 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:24:34.173803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:24:34.226006 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.237090 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:24:34.305879 tst mo_mt_call.py: using LAC 23502 20:24:34.427315 tst mo_mt_call.py: using RAC 42 20:24:34.547533 tst mo_mt_call.py: using CellId 23502 20:24:34.668324 tst mo_mt_call.py: using BVCI 23503 20:24:34.778703 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.789787 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.800563 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.811697 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.822865 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:34.834008 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:34.953506 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:35.074306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:35.582455 run create_hlr_db(pid=11559): Launched 20:24:35.717560 bus /sierra_2: Setting Powered False 20:24:36.782543 run create_hlr_db(pid=11559): Terminated: ok {rc=0} 20:24:37.239113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Launched 20:24:37.567485 run osmo-hlr_10.42.42.2(pid=11562): Launched 20:24:37.692392 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:38.258928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Launched 20:24:38.586730 run osmo-stp_10.42.42.5(pid=11565): Launched 20:24:38.712434 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:39.307530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11567): Launched 20:24:39.635621 run osmo-msc_10.42.42.6(pid=11568): Launched 20:24:39.818263 run osmo-stp_10.42.42.5(pid=11565): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] 20:24:39.955897 run osmo-stp_10.42.42.5(pid=11565): stdout: | (launched: 2022-12-09_20:24:38.527127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:40.093991 run osmo-stp_10.42.42.5(pid=11565): stderr: | 20221209202438721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202438722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202438722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202438722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202438723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202438723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202438723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:40.231409 run osmo-stp_10.42.42.5(pid=11565): stdout: | (launched: 2022-12-09_20:24:38.527127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:40.363277 run osmo-stp_10.42.42.5(pid=11565): stderr: | 20221209202438721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202438722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202438722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202438722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202438723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202438723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202438723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:40.520019 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11565): Process ended prematurely: osmo-stp_10.42.42.5(pid=11565) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:24:40.530077 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:24:40.558303 run osmo-hlr_10.42.42.2(pid=11562): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11562)] 20:24:40.608596 run osmo-hlr_10.42.42.2(pid=11562): stdout: | (launched: 2022-12-09_20:24:37.507623) 20:24:40.660619 run osmo-hlr_10.42.42.2(pid=11562): stderr: | 20221209202437708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202437708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202437708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202437708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202437708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202437708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202437721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202437729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202437729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202437729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:40.732919 run osmo-msc_10.42.42.6(pid=11568): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11568)] 20:24:40.782515 run osmo-msc_10.42.42.6(pid=11568): stdout: | (launched: 2022-12-09_20:24:39.575445) 20:24:40.834292 run osmo-msc_10.42.42.6(pid=11568): stderr: | 20221209202439901 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202439901 DLGLOBAL DEBUG validating counter group 0x7fb2664a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202439901 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202439901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202439901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202439901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202439903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202439903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202439903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202439904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:40.886249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Terminating (SIGTERM) 20:24:40.927693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Terminating (SIGTERM) 20:24:40.969146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11567): Terminating (SIGTERM) 20:24:41.011096 --- ParallelTerminationStrategy: PID 11561 died... 20:24:41.031003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11561): Terminated: ok {rc=0} 20:24:41.077355 --- ParallelTerminationStrategy: PID 11564 died... 20:24:41.096768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11564): Terminated: ok {rc=0} 20:24:41.143057 --- ParallelTerminationStrategy: PID 11567 died... 20:24:41.162597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11567): Terminated: ok {rc=0} 20:24:41.250912 bus /sierra_3: Setting Powered False 20:24:42.348516 bus /sierra_3: Setting Powered False 20:24:43.463358 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:24:44.612742 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:44.625176 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:24:44.696557 tst mo_mt_call_osmux.py: using LAC 23503 20:24:44.826876 tst mo_mt_call_osmux.py: using RAC 43 20:24:44.955847 tst mo_mt_call_osmux.py: using CellId 23503 20:24:45.086215 tst mo_mt_call_osmux.py: using BVCI 23504 20:24:45.206716 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:45.218238 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:45.229668 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:45.241703 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:45.253272 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:24:45.264589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:45.381549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:24:45.498569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:46.014265 run create_hlr_db(pid=11570): Launched 20:24:46.166672 bus /sierra_2: Setting Powered False 20:24:47.239427 run create_hlr_db(pid=11570): Terminated: ok {rc=0} 20:24:47.699545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11572): Launched 20:24:48.028887 run osmo-hlr_10.42.42.2(pid=11573): Launched 20:24:48.153276 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:48.721190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11575): Launched 20:24:49.047538 run osmo-stp_10.42.42.5(pid=11576): Launched 20:24:49.171977 run osmo-msc_10.42.42.6: Starting osmo-msc 20:24:49.763520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11578): Launched 20:24:50.090778 run osmo-msc_10.42.42.6(pid=11579): Launched 20:24:50.273551 run osmo-stp_10.42.42.5(pid=11576): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11576)] 20:24:50.411510 run osmo-stp_10.42.42.5(pid=11576): stdout: | (launched: 2022-12-09_20:24:48.987578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:50.552019 run osmo-stp_10.42.42.5(pid=11576): stderr: | 20221209202449180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202449181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202449181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202449181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202449182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202449182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202449182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:50.689319 run osmo-stp_10.42.42.5(pid=11576): stdout: | (launched: 2022-12-09_20:24:48.987578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:24:50.819956 run osmo-stp_10.42.42.5(pid=11576): stderr: | 20221209202449180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202449181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202449181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202449181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202449182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202449182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202449182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:24:50.976103 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11576): Process ended prematurely: osmo-stp_10.42.42.5(pid=11576) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11576)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:24:50.986431 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:24:51.014416 run osmo-hlr_10.42.42.2(pid=11573): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11573)] 20:24:51.064310 run osmo-hlr_10.42.42.2(pid=11573): stdout: | (launched: 2022-12-09_20:24:47.968861) 20:24:51.116179 run osmo-hlr_10.42.42.2(pid=11573): stderr: | 20221209202448168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202448168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202448168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202448168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202448168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202448168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202448181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202448190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202448190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202448190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:24:51.188641 run osmo-msc_10.42.42.6(pid=11579): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11579)] 20:24:51.238734 run osmo-msc_10.42.42.6(pid=11579): stdout: | (launched: 2022-12-09_20:24:50.030518) 20:24:51.290495 run osmo-msc_10.42.42.6(pid=11579): stderr: | 20221209202450355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202450355 DLGLOBAL DEBUG validating counter group 0x7fb1c561ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202450355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202450355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202450355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202450355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202450357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202450357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202450358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202450358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:24:51.342686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11572): Terminating (SIGTERM) 20:24:51.384541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11575): Terminating (SIGTERM) 20:24:51.426527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11578): Terminating (SIGTERM) 20:24:51.468709 --- ParallelTerminationStrategy: PID 11572 died... 20:24:51.488830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11572): Terminated: ok {rc=0} 20:24:51.535356 --- ParallelTerminationStrategy: PID 11575 died... 20:24:51.555007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11575): Terminated: ok {rc=0} 20:24:51.601102 --- ParallelTerminationStrategy: PID 11578 died... 20:24:51.620485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11578): Terminated: ok {rc=0} 20:24:51.708081 bus /sierra_3: Setting Powered False 20:24:52.806308 bus /sierra_3: Setting Powered False 20:24:53.924151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:24:55.172554 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:24:55.179191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:24:55.212645 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:24:55.239063 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:24:55.291015 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:24:55.325319 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:24:55.351750 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:24:55.900043 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:24:55.949644 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:55.960825 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:24:56.029273 tst mo_mt_call.py: using LAC 23504 20:24:56.151423 tst mo_mt_call.py: using RAC 44 20:24:56.273611 tst mo_mt_call.py: using CellId 23504 20:24:56.397163 tst mo_mt_call.py: using BVCI 23505 20:24:56.517242 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:56.528834 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:56.540506 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:56.552306 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:56.564144 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:24:56.575819 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:56.693295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:24:56.812744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:24:57.321818 run create_hlr_db(pid=11584): Launched 20:24:57.456592 bus /sierra_2: Setting Powered False 20:24:58.521584 run create_hlr_db(pid=11584): Terminated: ok {rc=0} 20:24:58.959247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11586): Launched 20:24:59.266685 run osmo-hlr_10.42.42.2(pid=11587): Launched 20:24:59.382904 run osmo-stp_10.42.42.5: Starting osmo-stp 20:24:59.924312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11589): Launched 20:25:00.230922 run osmo-stp_10.42.42.5(pid=11590): Launched 20:25:00.346726 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:00.915905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11592): Launched 20:25:01.277748 run osmo-msc_10.42.42.6(pid=11593): Launched 20:25:01.779436 run osmo-stp_10.42.42.5(pid=11590): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11590)] 20:25:02.130769 run osmo-stp_10.42.42.5(pid=11590): stdout: | (launched: 2022-12-09_20:25:00.174435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:02.271598 run osmo-stp_10.42.42.5(pid=11590): stderr: | 20221209202500345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202500346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202500346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202500346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202500347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202500347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202500347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:02.411650 run osmo-stp_10.42.42.5(pid=11590): stdout: | (launched: 2022-12-09_20:25:00.174435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:02.543738 run osmo-stp_10.42.42.5(pid=11590): stderr: | 20221209202500345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202500346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202500346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202500346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202500347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202500347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202500347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:02.700704 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11590): Process ended prematurely: osmo-stp_10.42.42.5(pid=11590) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11590)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:25:02.710811 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 20:25:02.739339 run osmo-hlr_10.42.42.2(pid=11587): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11587)] 20:25:02.790007 run osmo-hlr_10.42.42.2(pid=11587): stdout: | (launched: 2022-12-09_20:24:59.210287) 20:25:02.842741 run osmo-hlr_10.42.42.2(pid=11587): stderr: | 20221209202459389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202459389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202459389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202459389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202459389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202459389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202459401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202459411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202459411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202459411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:02.915572 run osmo-msc_10.42.42.6(pid=11593): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11593)] 20:25:02.966206 run osmo-msc_10.42.42.6(pid=11593): stdout: | (launched: 2022-12-09_20:25:01.207070) 20:25:03.018370 run osmo-msc_10.42.42.6(pid=11593): stderr: | 20221209202501611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202501611 DLGLOBAL DEBUG validating counter group 0x7fd54650cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202501611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202501611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202501611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202501612 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202501614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202501616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202501616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202501617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:03.071169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11586): Terminating (SIGTERM) 20:25:03.113456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11589): Terminating (SIGTERM) 20:25:03.155800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11592): Terminating (SIGTERM) 20:25:03.198569 --- ParallelTerminationStrategy: PID 11586 died... 20:25:03.218464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11586): Terminated: ok {rc=0} 20:25:03.265401 --- ParallelTerminationStrategy: PID 11589 died... 20:25:03.285137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11589): Terminated: ok {rc=0} 20:25:03.332039 --- ParallelTerminationStrategy: PID 11592 died... 20:25:03.351830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11592): Terminated: ok {rc=0} 20:25:03.440096 bus /sierra_3: Setting Powered False 20:25:04.539775 bus /sierra_3: Setting Powered False 20:25:05.655398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:25:06.805930 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:06.818286 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:25:06.890902 tst mo_mt_call_osmux.py: using LAC 23505 20:25:07.024377 tst mo_mt_call_osmux.py: using RAC 45 20:25:07.153102 tst mo_mt_call_osmux.py: using CellId 23505 20:25:07.282517 tst mo_mt_call_osmux.py: using BVCI 23506 20:25:07.403156 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:07.414728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:07.426213 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:07.437756 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:07.449292 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:25:07.460728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:25:07.582216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:25:07.705250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:08.215583 run create_hlr_db(pid=11598): Launched 20:25:08.348240 bus /sierra_2: Setting Powered False 20:25:09.413812 run create_hlr_db(pid=11598): Terminated: ok {rc=0} 20:25:09.853709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11600): Launched 20:25:10.161781 run osmo-hlr_10.42.42.2(pid=11601): Launched 20:25:10.278783 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:10.846864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11603): Launched 20:25:11.177367 run osmo-stp_10.42.42.5(pid=11604): Launched 20:25:11.303650 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:11.897698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11606): Launched 20:25:12.225964 run osmo-msc_10.42.42.6(pid=11607): Launched 20:25:12.409976 run osmo-stp_10.42.42.5(pid=11604): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11604)] 20:25:12.548576 run osmo-stp_10.42.42.5(pid=11604): stdout: | (launched: 2022-12-09_20:25:11.117195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:12.687094 run osmo-stp_10.42.42.5(pid=11604): stderr: | 20221209202511313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202511313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202511314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202511314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202511315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202511315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202511315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:12.825851 run osmo-stp_10.42.42.5(pid=11604): stdout: | (launched: 2022-12-09_20:25:11.117195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:12.957297 run osmo-stp_10.42.42.5(pid=11604): stderr: | 20221209202511313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202511313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202511314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202511314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202511315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202511315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202511315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:13.114351 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11604): Process ended prematurely: osmo-stp_10.42.42.5(pid=11604) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11604)] [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:25:13.124154 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:25:13.152739 run osmo-hlr_10.42.42.2(pid=11601): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11601)] 20:25:13.203583 run osmo-hlr_10.42.42.2(pid=11601): stdout: | (launched: 2022-12-09_20:25:10.105092) 20:25:13.256012 run osmo-hlr_10.42.42.2(pid=11601): stderr: | 20221209202510283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202510283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202510283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202510283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202510283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202510283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202510295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202510303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202510304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202510304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:13.329191 run osmo-msc_10.42.42.6(pid=11607): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11607)] 20:25:13.379514 run osmo-msc_10.42.42.6(pid=11607): stdout: | (launched: 2022-12-09_20:25:12.165707) 20:25:13.431343 run osmo-msc_10.42.42.6(pid=11607): stderr: | 20221209202512489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202512490 DLGLOBAL DEBUG validating counter group 0x7f636900dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202512490 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202512490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202512490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202512490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202512492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202512492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202512493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202512493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:13.483397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11600): Terminating (SIGTERM) 20:25:13.525603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11603): Terminating (SIGTERM) 20:25:13.567651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11606): Terminating (SIGTERM) 20:25:13.609997 --- ParallelTerminationStrategy: PID 11600 died... 20:25:13.630108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11600): Terminated: ok {rc=0} 20:25:13.676836 --- ParallelTerminationStrategy: PID 11603 died... 20:25:13.696891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11603): Terminated: ok {rc=0} 20:25:13.743545 --- ParallelTerminationStrategy: PID 11606 died... 20:25:13.763318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11606): Terminated: ok {rc=0} 20:25:13.852003 bus /sierra_3: Setting Powered False 20:25:14.951885 bus /sierra_3: Setting Powered False 20:25:16.077875 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:25:17.343152 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:17.350203 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:25:17.384499 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:25:17.411919 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:25:17.464243 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:25:17.498334 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:25:17.525577 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:25:18.077999 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:25:18.128360 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.139489 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:25:18.210435 tst mo_mt_call.py: using LAC 23506 20:25:18.337814 tst mo_mt_call.py: using RAC 46 20:25:18.463825 tst mo_mt_call.py: using CellId 23506 20:25:18.591244 tst mo_mt_call.py: using BVCI 23507 20:25:18.707845 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.719538 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.730984 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.742607 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.754246 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:18.765762 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:18.879224 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:18.994891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:19.490367 run create_hlr_db(pid=11612): Launched 20:25:19.619466 bus /sierra_2: Setting Powered False 20:25:20.682705 run create_hlr_db(pid=11612): Terminated: ok {rc=0} 20:25:21.128138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Launched 20:25:21.448164 run osmo-hlr_10.42.42.2(pid=11615): Launched 20:25:21.570045 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:22.122431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Launched 20:25:22.441140 run osmo-stp_10.42.42.5(pid=11618): Launched 20:25:22.562489 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:23.142399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11620): Launched 20:25:23.462094 run osmo-msc_10.42.42.6(pid=11621): Launched 20:25:23.639172 run osmo-stp_10.42.42.5(pid=11618): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11618)] 20:25:23.774399 run osmo-stp_10.42.42.5(pid=11618): stdout: | (launched: 2022-12-09_20:25:22.382582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:23.909139 run osmo-stp_10.42.42.5(pid=11618): stderr: | 20221209202522574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202522574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202522575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202522575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202522576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202522576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202522576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:24.043133 run osmo-stp_10.42.42.5(pid=11618): stdout: | (launched: 2022-12-09_20:25:22.382582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:24.170571 run osmo-stp_10.42.42.5(pid=11618): stderr: | 20221209202522574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202522574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202522575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202522575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202522576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202522576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202522576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:24.322945 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11618): Process ended prematurely: osmo-stp_10.42.42.5(pid=11618) [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11618)] [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:25:24.332515 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:25:24.360525 run osmo-hlr_10.42.42.2(pid=11615): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11615)] 20:25:24.410543 run osmo-hlr_10.42.42.2(pid=11615): stdout: | (launched: 2022-12-09_20:25:21.389882) 20:25:24.462055 run osmo-hlr_10.42.42.2(pid=11615): stderr: | 20221209202521591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202521591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202521591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202521591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202521591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202521591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202521604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202521614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202521614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202521614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:24.533789 run osmo-msc_10.42.42.6(pid=11621): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11621)] 20:25:24.583125 run osmo-msc_10.42.42.6(pid=11621): stdout: | (launched: 2022-12-09_20:25:23.403171) 20:25:24.634448 run osmo-msc_10.42.42.6(pid=11621): stderr: | 20221209202523725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202523725 DLGLOBAL DEBUG validating counter group 0x7f9f7c344c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202523726 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202523726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202523726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202523726 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202523728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202523728 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202523728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202523728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:24.685731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Terminating (SIGTERM) 20:25:24.727012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Terminating (SIGTERM) 20:25:24.768499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11620): Terminating (SIGTERM) 20:25:24.810364 --- ParallelTerminationStrategy: PID 11614 died... 20:25:24.829919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11614): Terminated: ok {rc=0} 20:25:24.876170 --- ParallelTerminationStrategy: PID 11617 died... 20:25:24.895719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11617): Terminated: ok {rc=0} 20:25:24.941619 --- ParallelTerminationStrategy: PID 11620 died... 20:25:24.960919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11620): Terminated: ok {rc=0} 20:25:25.047520 bus /sierra_3: Setting Powered False 20:25:26.145068 bus /sierra_3: Setting Powered False 20:25:27.261961 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:25:28.409296 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:28.421441 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:25:28.492781 tst mo_mt_call_osmux.py: using LAC 23507 20:25:28.622527 tst mo_mt_call_osmux.py: using RAC 47 20:25:28.747552 tst mo_mt_call_osmux.py: using CellId 23507 20:25:28.864377 tst mo_mt_call_osmux.py: using BVCI 23508 20:25:28.972527 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:28.983683 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:28.994639 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:29.005918 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:29.017115 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:25:29.028201 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:29.146831 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:25:29.264180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:29.760621 run create_hlr_db(pid=11623): Launched 20:25:29.890824 bus /sierra_2: Setting Powered False 20:25:30.961949 run create_hlr_db(pid=11623): Terminated: ok {rc=0} 20:25:31.443975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11625): Launched 20:25:31.775471 run osmo-hlr_10.42.42.2(pid=11626): Launched 20:25:31.902982 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:32.631797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11628): Launched 20:25:32.930071 run osmo-stp_10.42.42.5(pid=11629): Launched 20:25:33.043042 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:33.581717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11631): Launched 20:25:33.879809 run osmo-msc_10.42.42.6(pid=11632): Launched 20:25:34.045774 run osmo-stp_10.42.42.5(pid=11629): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11629)] 20:25:34.171715 run osmo-stp_10.42.42.5(pid=11629): stdout: | (launched: 2022-12-09_20:25:32.875389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:34.298171 run osmo-stp_10.42.42.5(pid=11629): stderr: | 20221209202533041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202533041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202533042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202533042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202533042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202533042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202533043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:34.422398 run osmo-stp_10.42.42.5(pid=11629): stdout: | (launched: 2022-12-09_20:25:32.875389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:34.541183 run osmo-stp_10.42.42.5(pid=11629): stderr: | 20221209202533041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202533041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202533042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202533042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202533042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202533042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202533043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:34.683473 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11629): Process ended prematurely: osmo-stp_10.42.42.5(pid=11629) [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11629)] [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:25:34.692549 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:25:34.719378 run osmo-hlr_10.42.42.2(pid=11626): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11626)] 20:25:34.766965 run osmo-hlr_10.42.42.2(pid=11626): stdout: | (launched: 2022-12-09_20:25:31.710799) 20:25:34.816077 run osmo-hlr_10.42.42.2(pid=11626): stderr: | 20221209202532129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202532129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202532129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202532130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202532130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202532130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202532154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202532180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202532180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202532180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:34.884657 run osmo-msc_10.42.42.6(pid=11632): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11632)] 20:25:34.931873 run osmo-msc_10.42.42.6(pid=11632): stdout: | (launched: 2022-12-09_20:25:33.825237) 20:25:34.980692 run osmo-msc_10.42.42.6(pid=11632): stderr: | 20221209202534093 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202534093 DLGLOBAL DEBUG validating counter group 0x7f8372f28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202534093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202534093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202534093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202534094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202534095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202534096 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202534096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202534096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:35.030180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11625): Terminating (SIGTERM) 20:25:35.069398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11628): Terminating (SIGTERM) 20:25:35.108788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11631): Terminating (SIGTERM) 20:25:35.148439 --- ParallelTerminationStrategy: PID 11625 died... 20:25:35.167199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11625): Terminated: ok {rc=0} 20:25:35.211212 --- ParallelTerminationStrategy: PID 11628 died... 20:25:35.229439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11628): Terminated: ok {rc=0} 20:25:35.272927 --- ParallelTerminationStrategy: PID 11631 died... 20:25:35.291138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11631): Terminated: ok {rc=0} 20:25:35.376301 bus /sierra_3: Setting Powered False 20:25:36.475328 bus /sierra_3: Setting Powered False 20:25:37.590874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:25:38.838250 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:38.843777 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:25:38.877036 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:25:38.903207 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:25:38.954636 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:25:38.988527 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:25:39.014650 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:25:39.561126 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:25:39.609890 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:39.620607 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:25:39.689625 tst mo_mt_call.py: using LAC 23508 20:25:39.809384 tst mo_mt_call.py: using RAC 48 20:25:39.928543 tst mo_mt_call.py: using CellId 23508 20:25:40.045335 tst mo_mt_call.py: using BVCI 23509 20:25:40.153333 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:40.164034 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:40.174649 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:40.185639 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:40.196460 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:40.207351 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:40.321452 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:40.437279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:40.901524 run create_hlr_db(pid=11638): Launched 20:25:41.015225 bus /sierra_2: Setting Powered False 20:25:42.075219 run create_hlr_db(pid=11638): Terminated: ok {rc=0} 20:25:42.511682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11640): Launched 20:25:42.832335 run osmo-hlr_10.42.42.2(pid=11641): Launched 20:25:42.955365 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:43.506732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11643): Launched 20:25:43.825515 run osmo-stp_10.42.42.5(pid=11644): Launched 20:25:43.947602 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:44.523783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11646): Launched 20:25:44.843636 run osmo-msc_10.42.42.6(pid=11647): Launched 20:25:45.021278 run osmo-stp_10.42.42.5(pid=11644): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11644)] 20:25:45.155604 run osmo-stp_10.42.42.5(pid=11644): stdout: | (launched: 2022-12-09_20:25:43.767297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:45.290612 run osmo-stp_10.42.42.5(pid=11644): stderr: | 20221209202543956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202543956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202543956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202543957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202543957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202543957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202543957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:45.424738 run osmo-stp_10.42.42.5(pid=11644): stdout: | (launched: 2022-12-09_20:25:43.767297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:45.552472 run osmo-stp_10.42.42.5(pid=11644): stderr: | 20221209202543956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202543956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202543956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202543957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202543957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202543957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202543957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:45.705295 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11644): Process ended prematurely: osmo-stp_10.42.42.5(pid=11644) [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11644)] [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:25:45.715162 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:25:45.743158 run osmo-hlr_10.42.42.2(pid=11641): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11641)] 20:25:45.793203 run osmo-hlr_10.42.42.2(pid=11641): stdout: | (launched: 2022-12-09_20:25:42.774144) 20:25:45.862807 run osmo-hlr_10.42.42.2(pid=11641): stderr: | 20221209202542970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202542970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202542970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202542970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202542970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202542970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202542983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202542991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202542991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202542992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:45.956585 run osmo-msc_10.42.42.6(pid=11647): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11647)] 20:25:46.007909 run osmo-msc_10.42.42.6(pid=11647): stdout: | (launched: 2022-12-09_20:25:44.785086) 20:25:46.062334 run osmo-msc_10.42.42.6(pid=11647): stderr: | 20221209202545102 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202545103 DLGLOBAL DEBUG validating counter group 0x7ff16d335c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202545103 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202545103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202545103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202545103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202545105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202545105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202545105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202545106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:46.115275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11640): Terminating (SIGTERM) 20:25:46.158587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11643): Terminating (SIGTERM) 20:25:46.203038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11646): Terminating (SIGTERM) 20:25:46.247075 --- ParallelTerminationStrategy: PID 11640 died... 20:25:46.267287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11640): Terminated: ok {rc=0} 20:25:46.318085 --- ParallelTerminationStrategy: PID 11643 died... 20:25:46.338039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11643): Terminated: ok {rc=0} 20:25:46.384501 --- ParallelTerminationStrategy: PID 11646 died... 20:25:46.404516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11646): Terminated: ok {rc=0} 20:25:46.492503 bus /sierra_3: Setting Powered False 20:25:47.591662 bus /sierra_3: Setting Powered False 20:25:48.709258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:25:49.854647 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:49.866143 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:25:49.936049 tst mo_mt_call_osmux.py: using LAC 23509 20:25:50.054700 tst mo_mt_call_osmux.py: using RAC 49 20:25:50.172718 tst mo_mt_call_osmux.py: using CellId 23509 20:25:50.289560 tst mo_mt_call_osmux.py: using BVCI 23510 20:25:50.399076 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:50.409976 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:50.420629 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:50.431567 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:50.442535 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:25:50.453436 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:50.567832 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:25:50.685355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:25:51.179483 run create_hlr_db(pid=11649): Launched 20:25:51.308496 bus /sierra_2: Setting Powered False 20:25:52.372182 run create_hlr_db(pid=11649): Terminated: ok {rc=0} 20:25:52.796757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Launched 20:25:53.094172 run osmo-hlr_10.42.42.2(pid=11652): Launched 20:25:53.207047 run osmo-stp_10.42.42.5: Starting osmo-stp 20:25:53.727310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Launched 20:25:54.023635 run osmo-stp_10.42.42.5(pid=11655): Launched 20:25:54.135722 run osmo-msc_10.42.42.6: Starting osmo-msc 20:25:54.671940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Launched 20:25:54.968407 run osmo-msc_10.42.42.6(pid=11658): Launched 20:25:55.134767 run osmo-stp_10.42.42.5(pid=11655): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] 20:25:55.260721 run osmo-stp_10.42.42.5(pid=11655): stdout: | (launched: 2022-12-09_20:25:53.969532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:55.386976 run osmo-stp_10.42.42.5(pid=11655): stderr: | 20221209202554137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202554137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202554137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202554137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202554138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202554138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202554138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:55.510769 run osmo-stp_10.42.42.5(pid=11655): stdout: | (launched: 2022-12-09_20:25:53.969532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:25:55.629488 run osmo-stp_10.42.42.5(pid=11655): stderr: | 20221209202554137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202554137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202554137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202554137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202554138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202554138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202554138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:25:55.771429 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11655): Process ended prematurely: osmo-stp_10.42.42.5(pid=11655) [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:25:55.780149 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:25:55.806481 run osmo-hlr_10.42.42.2(pid=11652): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11652)] 20:25:55.854145 run osmo-hlr_10.42.42.2(pid=11652): stdout: | (launched: 2022-12-09_20:25:53.039887) 20:25:55.903120 run osmo-hlr_10.42.42.2(pid=11652): stderr: | 20221209202553211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202553211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202553211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202553211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202553211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202553211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202553224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202553234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202553234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202553234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:25:55.971155 run osmo-msc_10.42.42.6(pid=11658): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11658)] 20:25:56.018397 run osmo-msc_10.42.42.6(pid=11658): stdout: | (launched: 2022-12-09_20:25:54.913916) 20:25:56.067180 run osmo-msc_10.42.42.6(pid=11658): stderr: | 20221209202555180 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202555180 DLGLOBAL DEBUG validating counter group 0x7fdeebf90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202555180 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202555180 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202555181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202555181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202555184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202555184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202555185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202555185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:25:56.116488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Terminating (SIGTERM) 20:25:56.155565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Terminating (SIGTERM) 20:25:56.194583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Terminating (SIGTERM) 20:25:56.233846 --- ParallelTerminationStrategy: PID 11651 died... 20:25:56.252626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11651): Terminated: ok {rc=0} 20:25:56.296384 --- ParallelTerminationStrategy: PID 11654 died... 20:25:56.314738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11654): Terminated: ok {rc=0} 20:25:56.363437 --- ParallelTerminationStrategy: PID 11657 died... 20:25:56.383077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11657): Terminated: ok {rc=0} 20:25:56.471656 bus /sierra_3: Setting Powered False 20:25:57.569521 bus /sierra_3: Setting Powered False 20:25:58.687125 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 20:25:59.934160 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:25:59.938989 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 20:25:59.972140 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 20:25:59.998564 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 20:26:00.055499 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 20:26:00.088080 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 20:26:00.114269 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 20:26:00.656099 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 20:26:00.704027 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:00.714796 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:26:00.762342 tst mo_mt_call.py: using LAC 23510 20:26:00.912520 tst mo_mt_call.py: using RAC 50 20:26:01.049233 tst mo_mt_call.py: using CellId 23510 20:26:01.166208 tst mo_mt_call.py: using BVCI 23511 20:26:01.280086 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:01.291928 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:01.303512 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:01.316412 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:01.330242 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:01.341925 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:26:01.466501 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:26:01.584171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:02.100157 run create_hlr_db(pid=11664): Launched 20:26:02.263760 bus /sierra_2: Setting Powered False 20:26:03.325594 run create_hlr_db(pid=11664): Terminated: ok {rc=0} 20:26:03.746308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Launched 20:26:04.039504 run osmo-hlr_10.42.42.2(pid=11667): Launched 20:26:04.151105 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:04.669940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Launched 20:26:04.963833 run osmo-stp_10.42.42.5(pid=11670): Launched 20:26:05.075802 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:05.608783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11672): Launched 20:26:05.902422 run osmo-msc_10.42.42.6(pid=11673): Launched 20:26:06.067007 run osmo-stp_10.42.42.5(pid=11670): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] 20:26:06.191880 run osmo-stp_10.42.42.5(pid=11670): stdout: | (launched: 2022-12-09_20:26:04.910093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:06.317108 run osmo-stp_10.42.42.5(pid=11670): stderr: | 20221209202605074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202605074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202605075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202605075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202605076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202605076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202605076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:06.439842 run osmo-stp_10.42.42.5(pid=11670): stdout: | (launched: 2022-12-09_20:26:04.910093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:06.557805 run osmo-stp_10.42.42.5(pid=11670): stderr: | 20221209202605074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202605074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202605075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202605075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202605076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202605076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202605076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:06.698463 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11670): Process ended prematurely: osmo-stp_10.42.42.5(pid=11670) [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 20:26:06.707421 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:26:06.733768 run osmo-hlr_10.42.42.2(pid=11667): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11667)] 20:26:06.780653 run osmo-hlr_10.42.42.2(pid=11667): stdout: | (launched: 2022-12-09_20:26:03.985871) 20:26:06.829374 run osmo-hlr_10.42.42.2(pid=11667): stderr: | 20221209202604155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202604155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202604155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202604155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202604155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202604155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202604167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202604176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202604177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202604177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:06.897211 run osmo-msc_10.42.42.6(pid=11673): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11673)] 20:26:06.944357 run osmo-msc_10.42.42.6(pid=11673): stdout: | (launched: 2022-12-09_20:26:05.848924) 20:26:06.993075 run osmo-msc_10.42.42.6(pid=11673): stderr: | 20221209202606116 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202606116 DLGLOBAL DEBUG validating counter group 0x7fc20b9d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202606116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202606117 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202606117 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202606117 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202606119 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202606120 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202606120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202606120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:07.042157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Terminating (SIGTERM) 20:26:07.081180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Terminating (SIGTERM) 20:26:07.120419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11672): Terminating (SIGTERM) 20:26:07.160008 --- ParallelTerminationStrategy: PID 11666 died... 20:26:07.178934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11666): Terminated: ok {rc=0} 20:26:07.222873 --- ParallelTerminationStrategy: PID 11669 died... 20:26:07.241221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11669): Terminated: ok {rc=0} 20:26:07.285425 --- ParallelTerminationStrategy: PID 11672 died... 20:26:07.303890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11672): Terminated: ok {rc=0} 20:26:07.387628 bus /sierra_3: Setting Powered False 20:26:08.485332 bus /sierra_3: Setting Powered False 20:26:09.606315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 20:26:10.750000 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:10.761606 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 20:26:10.811722 tst mo_mt_call_osmux.py: using LAC 23511 20:26:10.929819 tst mo_mt_call_osmux.py: using RAC 51 20:26:11.047753 tst mo_mt_call_osmux.py: using CellId 23511 20:26:11.165389 tst mo_mt_call_osmux.py: using BVCI 23512 20:26:11.272830 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:11.283657 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:11.294288 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:11.305052 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:11.315813 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 20:26:11.326614 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:26:11.440183 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 20:26:11.558835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:12.049687 run create_hlr_db(pid=11675): Launched 20:26:12.178083 bus /sierra_2: Setting Powered False 20:26:13.240714 run create_hlr_db(pid=11675): Terminated: ok {rc=0} 20:26:13.662250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11677): Launched 20:26:13.957226 run osmo-hlr_10.42.42.2(pid=11678): Launched 20:26:14.068493 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:14.614349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11680): Launched 20:26:14.929331 run osmo-stp_10.42.42.5(pid=11681): Launched 20:26:15.049353 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:15.620836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11683): Launched 20:26:15.949699 run osmo-msc_10.42.42.6(pid=11684): Launched 20:26:16.235013 run osmo-stp_10.42.42.5(pid=11681): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11681)] 20:26:16.449275 run osmo-stp_10.42.42.5(pid=11681): stdout: | (launched: 2022-12-09_20:26:14.871997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:16.632840 run osmo-stp_10.42.42.5(pid=11681): stderr: | 20221209202615059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202615059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202615060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202615060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202615061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202615061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202615061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:16.928553 run osmo-stp_10.42.42.5(pid=11681): stdout: | (launched: 2022-12-09_20:26:14.871997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:17.166247 run osmo-stp_10.42.42.5(pid=11681): stderr: | 20221209202615059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202615059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202615060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202615060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202615061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202615061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202615061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:17.364409 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11681): Process ended prematurely: osmo-stp_10.42.42.5(pid=11681) [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11681)] [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 20:26:17.377417 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:26:17.413566 run osmo-hlr_10.42.42.2(pid=11678): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11678)] 20:26:17.463566 run osmo-hlr_10.42.42.2(pid=11678): stdout: | (launched: 2022-12-09_20:26:13.903013) 20:26:17.514983 run osmo-hlr_10.42.42.2(pid=11678): stderr: | 20221209202614075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202614075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202614075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202614075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202614075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202614075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202614087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202614096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202614096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202614096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:17.585198 run osmo-msc_10.42.42.6(pid=11684): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11684)] 20:26:17.632544 run osmo-msc_10.42.42.6(pid=11684): stdout: | (launched: 2022-12-09_20:26:15.883170) 20:26:17.681966 run osmo-msc_10.42.42.6(pid=11684): stderr: | 20221209202616629 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202616629 DLGLOBAL DEBUG validating counter group 0x7f18c7224c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202616629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202616629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202616630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202616630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202616631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202616632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202616632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202616632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:17.731438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11677): Terminating (SIGTERM) 20:26:17.770971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11680): Terminating (SIGTERM) 20:26:17.810733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11683): Terminating (SIGTERM) 20:26:17.850464 --- ParallelTerminationStrategy: PID 11677 died... 20:26:17.868827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11677): Terminated: ok {rc=0} 20:26:17.912772 --- ParallelTerminationStrategy: PID 11680 died... 20:26:17.931269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11680): Terminated: ok {rc=0} 20:26:17.974893 --- ParallelTerminationStrategy: PID 11683 died... 20:26:17.993335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11683): Terminated: ok {rc=0} 20:26:18.079189 bus /sierra_3: Setting Powered False 20:26:19.179265 bus /sierra_3: Setting Powered False 20:26:20.294371 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:26:21.537979 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:21.545550 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:26:21.578912 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:26:21.606064 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:26:21.659255 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:26:21.693386 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:26:21.720683 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:26:22.273359 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:26:22.324856 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.336570 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:26:22.389908 tst mo_mt_call.py: using LAC 23512 20:26:22.510875 tst mo_mt_call.py: using RAC 52 20:26:22.631476 tst mo_mt_call.py: using CellId 23512 20:26:22.752091 tst mo_mt_call.py: using BVCI 23513 20:26:22.863662 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.875000 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.886130 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.897354 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.908601 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:22.919791 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:23.033499 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:23.149655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:23.618593 run create_hlr_db(pid=11689): Launched 20:26:23.734406 bus /sierra_2: Setting Powered False 20:26:24.795150 run create_hlr_db(pid=11689): Terminated: ok {rc=0} 20:26:25.219502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11691): Launched 20:26:25.523361 run osmo-hlr_10.42.42.2(pid=11692): Launched 20:26:25.639819 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:26.176765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11694): Launched 20:26:26.480252 run osmo-stp_10.42.42.5(pid=11695): Launched 20:26:26.597391 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:27.146403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11697): Launched 20:26:27.449643 run osmo-msc_10.42.42.6(pid=11698): Launched 20:26:27.621206 run osmo-stp_10.42.42.5(pid=11695): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11695)] 20:26:27.750069 run osmo-stp_10.42.42.5(pid=11695): stdout: | (launched: 2022-12-09_20:26:26.424455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:27.878415 run osmo-stp_10.42.42.5(pid=11695): stderr: | 20221209202626593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202626594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202626594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202626594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202626595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202626595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202626595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:28.004715 run osmo-stp_10.42.42.5(pid=11695): stdout: | (launched: 2022-12-09_20:26:26.424455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:28.125988 run osmo-stp_10.42.42.5(pid=11695): stderr: | 20221209202626593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202626594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202626594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202626594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202626595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202626595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202626595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:28.270761 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11695): Process ended prematurely: osmo-stp_10.42.42.5(pid=11695) [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11695)] [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:26:28.280013 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:26:28.306982 run osmo-hlr_10.42.42.2(pid=11692): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11692)] 20:26:28.354331 run osmo-hlr_10.42.42.2(pid=11692): stdout: | (launched: 2022-12-09_20:26:25.467536) 20:26:28.403286 run osmo-hlr_10.42.42.2(pid=11692): stderr: | 20221209202625644 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202625644 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202625644 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202625644 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202625644 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202625644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202625656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202625665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202625665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202625665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:28.471508 run osmo-msc_10.42.42.6(pid=11698): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11698)] 20:26:28.518876 run osmo-msc_10.42.42.6(pid=11698): stdout: | (launched: 2022-12-09_20:26:27.393851) 20:26:28.567934 run osmo-msc_10.42.42.6(pid=11698): stderr: | 20221209202627662 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202627662 DLGLOBAL DEBUG validating counter group 0x7ff5075fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202627662 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202627663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202627663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202627663 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202627665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202627665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202627665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202627665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:28.617407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11691): Terminating (SIGTERM) 20:26:28.656724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11694): Terminating (SIGTERM) 20:26:28.696188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11697): Terminating (SIGTERM) 20:26:28.735904 --- ParallelTerminationStrategy: PID 11691 died... 20:26:28.754769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11691): Terminated: ok {rc=0} 20:26:28.798991 --- ParallelTerminationStrategy: PID 11694 died... 20:26:28.817547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11694): Terminated: ok {rc=0} 20:26:28.862037 --- ParallelTerminationStrategy: PID 11697 died... 20:26:28.880573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11697): Terminated: ok {rc=0} 20:26:28.965537 bus /sierra_3: Setting Powered False 20:26:30.063119 bus /sierra_3: Setting Powered False 20:26:31.190598 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:26:32.354911 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.367238 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:26:32.425063 tst mo_mt_call_osmux.py: using LAC 23513 20:26:32.551349 tst mo_mt_call_osmux.py: using RAC 53 20:26:32.677477 tst mo_mt_call_osmux.py: using CellId 23513 20:26:32.802602 tst mo_mt_call_osmux.py: using BVCI 23514 20:26:32.921963 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.933749 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.945192 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.956630 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.968228 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:26:32.979822 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:33.097857 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:26:33.221601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:33.722476 run create_hlr_db(pid=11700): Launched 20:26:33.852555 bus /sierra_2: Setting Powered False 20:26:34.912831 run create_hlr_db(pid=11700): Terminated: ok {rc=0} 20:26:35.363224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11702): Launched 20:26:35.685916 run osmo-hlr_10.42.42.2(pid=11703): Launched 20:26:35.809447 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:36.369499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11705): Launched 20:26:36.691831 run osmo-stp_10.42.42.5(pid=11706): Launched 20:26:36.814561 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:37.399400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11708): Launched 20:26:37.722204 run osmo-msc_10.42.42.6(pid=11709): Launched 20:26:37.902311 run osmo-stp_10.42.42.5(pid=11706): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11706)] 20:26:38.039531 run osmo-stp_10.42.42.5(pid=11706): stdout: | (launched: 2022-12-09_20:26:36.632821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:38.176103 run osmo-stp_10.42.42.5(pid=11706): stderr: | 20221209202636826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202636826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202636826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202636826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202636827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202636827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202636827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:38.311244 run osmo-stp_10.42.42.5(pid=11706): stdout: | (launched: 2022-12-09_20:26:36.632821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:38.439758 run osmo-stp_10.42.42.5(pid=11706): stderr: | 20221209202636826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202636826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202636826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202636826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202636827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202636827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202636827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:38.593733 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11706): Process ended prematurely: osmo-stp_10.42.42.5(pid=11706) [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11706)] [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:26:38.603213 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:26:38.630679 run osmo-hlr_10.42.42.2(pid=11703): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11703)] 20:26:38.680347 run osmo-hlr_10.42.42.2(pid=11703): stdout: | (launched: 2022-12-09_20:26:35.627183) 20:26:38.731747 run osmo-hlr_10.42.42.2(pid=11703): stderr: | 20221209202635826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202635826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202635826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202635826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202635826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202635826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202635838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202635847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202635847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202635847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:38.803453 run osmo-msc_10.42.42.6(pid=11709): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11709)] 20:26:38.852859 run osmo-msc_10.42.42.6(pid=11709): stdout: | (launched: 2022-12-09_20:26:37.663269) 20:26:38.904281 run osmo-msc_10.42.42.6(pid=11709): stderr: | 20221209202637984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202637984 DLGLOBAL DEBUG validating counter group 0x7f11422cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202637984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202637984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202637984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202637984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202637986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202637987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202637987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202637987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:38.955756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11702): Terminating (SIGTERM) 20:26:38.997017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11705): Terminating (SIGTERM) 20:26:39.038231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11708): Terminating (SIGTERM) 20:26:39.079779 --- ParallelTerminationStrategy: PID 11702 died... 20:26:39.099575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11702): Terminated: ok {rc=0} 20:26:39.145365 --- ParallelTerminationStrategy: PID 11705 died... 20:26:39.164690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11705): Terminated: ok {rc=0} 20:26:39.210986 --- ParallelTerminationStrategy: PID 11708 died... 20:26:39.230456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11708): Terminated: ok {rc=0} 20:26:39.318245 bus /sierra_3: Setting Powered False 20:26:40.417854 bus /sierra_3: Setting Powered False 20:26:41.533752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:trx-b200 --------------------------------------------------------------------- 20:26:42.779574 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:26:42.783789 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 20:26:42.816649 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 20:26:42.844135 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 20:26:42.927472 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 20:26:42.960123 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 20:26:42.986861 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 20:26:43.569534 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 20:26:43.574416 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:43.584878 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:26:43.633823 tst emergency_mo_mt_call.py: using LAC 23514 20:26:43.752531 tst emergency_mo_mt_call.py: using RAC 54 20:26:43.870520 tst emergency_mo_mt_call.py: using CellId 23514 20:26:43.987088 tst emergency_mo_mt_call.py: using BVCI 23515 20:26:44.094438 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:44.105157 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:44.115551 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:44.126210 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:44.136875 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:44.147537 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:44.266411 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:44.382183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:44.842971 run create_hlr_db(pid=11715): Launched 20:26:44.956409 bus /sierra_2: Setting Powered False 20:26:46.022523 run create_hlr_db(pid=11715): Terminated: ok {rc=0} 20:26:46.545751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11717): Launched 20:26:46.861184 run osmo-hlr_10.42.42.2(pid=11718): Launched 20:26:47.091346 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:47.714261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11720): Launched 20:26:48.033024 run osmo-stp_10.42.42.5(pid=11721): Launched 20:26:48.164591 tst emergency_mo_mt_call.py: using MSISDN 7366 20:26:48.331173 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:48.905534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11723): Launched 20:26:49.223388 run osmo-msc_10.42.42.6(pid=11724): Launched 20:26:49.401364 run osmo-stp_10.42.42.5(pid=11721): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11721)] 20:26:49.534884 run osmo-stp_10.42.42.5(pid=11721): stdout: | (launched: 2022-12-09_20:26:47.974620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:49.668726 run osmo-stp_10.42.42.5(pid=11721): stderr: | 20221209202648163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202648163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202648163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202648164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202648164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202648164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202648164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:49.801994 run osmo-stp_10.42.42.5(pid=11721): stdout: | (launched: 2022-12-09_20:26:47.974620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:26:49.928746 run osmo-stp_10.42.42.5(pid=11721): stderr: | 20221209202648163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202648163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202648163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202648164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202648164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202648164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202648164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:26:50.080153 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11721): Process ended prematurely: osmo-stp_10.42.42.5(pid=11721) [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11721)] [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 20:26:50.089202 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 20:26:50.116203 run osmo-hlr_10.42.42.2(pid=11718): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11718)] 20:26:50.165817 run osmo-hlr_10.42.42.2(pid=11718): stdout: | (launched: 2022-12-09_20:26:46.798982) 20:26:50.217314 run osmo-hlr_10.42.42.2(pid=11718): stderr: | 20221209202647139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202647139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202647139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202647139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202647139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202647139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202647159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202647172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202647172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202647172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:26:50.288621 run osmo-msc_10.42.42.6(pid=11724): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11724)] 20:26:50.338266 run osmo-msc_10.42.42.6(pid=11724): stdout: | (launched: 2022-12-09_20:26:49.165064) 20:26:50.389378 run osmo-msc_10.42.42.6(pid=11724): stderr: | 20221209202649486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202649486 DLGLOBAL DEBUG validating counter group 0x7f38c4507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202649486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202649486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202649486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202649486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202649488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202649489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202649489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202649489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:26:50.440897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11717): Terminating (SIGTERM) 20:26:50.482126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11720): Terminating (SIGTERM) 20:26:50.523409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11723): Terminating (SIGTERM) 20:26:50.564939 --- ParallelTerminationStrategy: PID 11717 died... 20:26:50.584697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11717): Terminated: ok {rc=0} 20:26:50.630234 --- ParallelTerminationStrategy: PID 11720 died... 20:26:50.649444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11720): Terminated: ok {rc=0} 20:26:50.695071 --- ParallelTerminationStrategy: PID 11723 died... 20:26:50.714344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11723): Terminated: ok {rc=0} 20:26:50.801323 bus /sierra_3: Setting Powered False 20:26:51.899356 bus /sierra_3: Setting Powered False 20:26:53.017172 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 20:26:54.103393 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.114724 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 20:26:54.166697 tst emergency_preemptive_call.py: using LAC 23515 20:26:54.284551 tst emergency_preemptive_call.py: using RAC 55 20:26:54.401122 tst emergency_preemptive_call.py: using CellId 23515 20:26:54.517380 tst emergency_preemptive_call.py: using BVCI 23516 20:26:54.626985 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.637709 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.648160 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.659318 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.670645 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 20:26:54.681829 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:54.795841 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:54.915201 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:55.030761 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 20:26:55.143993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:26:55.642287 run create_hlr_db(pid=11726): Launched 20:26:55.772567 bus /sierra_2: Setting Powered False 20:26:56.836104 run create_hlr_db(pid=11726): Terminated: ok {rc=0} 20:26:57.261503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11728): Launched 20:26:57.561255 run osmo-hlr_10.42.42.2(pid=11729): Launched 20:26:57.676750 run osmo-stp_10.42.42.5: Starting osmo-stp 20:26:58.193439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11731): Launched 20:26:58.490785 run osmo-stp_10.42.42.5(pid=11732): Launched 20:26:58.614477 tst emergency_preemptive_call.py: using MSISDN 7367 20:26:58.766817 run osmo-msc_10.42.42.6: Starting osmo-msc 20:26:59.298294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11734): Launched 20:26:59.594503 run osmo-msc_10.42.42.6(pid=11735): Launched 20:26:59.760645 run osmo-stp_10.42.42.5(pid=11732): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11732)] 20:26:59.886096 run osmo-stp_10.42.42.5(pid=11732): stdout: | (launched: 2022-12-09_20:26:58.436099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:00.011996 run osmo-stp_10.42.42.5(pid=11732): stderr: | 20221209202658604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202658604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202658604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202658605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202658605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202658605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202658606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:00.135855 run osmo-stp_10.42.42.5(pid=11732): stdout: | (launched: 2022-12-09_20:26:58.436099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:00.254016 run osmo-stp_10.42.42.5(pid=11732): stderr: | 20221209202658604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202658604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202658604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202658605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202658605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202658605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202658606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:00.395626 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11732): Process ended prematurely: osmo-stp_10.42.42.5(pid=11732) [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11732)] [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py:32] 20:27:00.403935 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 20:27:00.430203 run osmo-hlr_10.42.42.2(pid=11729): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11729)] 20:27:00.478458 run osmo-hlr_10.42.42.2(pid=11729): stdout: | (launched: 2022-12-09_20:26:57.506396) 20:27:00.527914 run osmo-hlr_10.42.42.2(pid=11729): stderr: | 20221209202657681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202657681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202657681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202657681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202657681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202657681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202657692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202657701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202657701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202657701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:00.596888 run osmo-msc_10.42.42.6(pid=11735): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11735)] 20:27:00.644779 run osmo-msc_10.42.42.6(pid=11735): stdout: | (launched: 2022-12-09_20:26:59.539738) 20:27:00.693811 run osmo-msc_10.42.42.6(pid=11735): stderr: | 20221209202659809 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209202659809 DLGLOBAL DEBUG validating counter group 0x7faa9c541c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209202659809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209202659809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209202659809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209202659809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209202659811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209202659812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209202659812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209202659812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:27:00.743431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11728): Terminating (SIGTERM) 20:27:00.782804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11731): Terminating (SIGTERM) 20:27:00.822204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11734): Terminating (SIGTERM) 20:27:00.878789 --- ParallelTerminationStrategy: PID 11728 died... 20:27:00.897782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11728): Terminated: ok {rc=0} 20:27:00.942512 --- ParallelTerminationStrategy: PID 11731 died... 20:27:00.961282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11731): Terminated: ok {rc=0} 20:27:01.005653 --- ParallelTerminationStrategy: PID 11734 died... 20:27:01.024247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11734): Terminated: ok {rc=0} 20:27:01.113071 bus /sierra_9: Setting Powered False 20:27:02.229268 bus /sierra_9: Setting Powered False 20:27:03.342105 bus /sierra_8: Setting Powered False 20:27:04.439673 bus /sierra_8: Setting Powered False 20:27:05.555987 bus /sierra_3: Setting Powered False 20:27:06.653770 bus /sierra_3: Setting Powered False 20:27:07.768878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-b200 --------------------------------------------------------------------- 20:27:09.048665 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:27:09.053208 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 20:27:09.086728 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 20:27:09.125744 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 20:27:09.212433 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 20:27:09.245912 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 20:27:09.285056 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 20:27:09.878426 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 20:27:09.931196 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:09.942232 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:09.994681 tst cs_paging_gprs_active.py: using LAC 23516 20:27:10.121274 tst cs_paging_gprs_active.py: using RAC 56 20:27:10.246779 tst cs_paging_gprs_active.py: using CellId 23516 20:27:10.373429 tst cs_paging_gprs_active.py: using BVCI 23517 20:27:10.484446 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.495123 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.505595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.516253 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.526914 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.537494 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.548175 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.558608 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:10.569646 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:10.688350 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:10.808419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:27:11.028495 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:11.353703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Launched 20:27:11.636111 run iperf3-srv_10.42.42.10(pid=11742): Launched 20:27:11.757735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:27:11.977510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:12.303228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11743): Launched 20:27:12.585981 run iperf3-srv_10.42.42.10(pid=11744): Launched 20:27:12.707166 tst cs_paging_gprs_active.py:38: start network... 20:27:12.927147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:13.431539 run create_hlr_db(pid=11745): Launched 20:27:13.554582 bus /sierra_2: Setting Powered False 20:27:14.614887 run create_hlr_db(pid=11745): Terminated: ok {rc=0} 20:27:15.036559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Launched 20:27:15.339668 run osmo-hlr_10.42.42.2(pid=11748): Launched 20:27:15.455313 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:16.029729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Launched 20:27:16.344762 run osmo-stp_10.42.42.5(pid=11751): Launched 20:27:16.585351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:17.216596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11753): Launched 20:27:17.336207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:17.594100 run patchelf(pid=11754): Launched 20:27:17.762574 run osmo-stp_10.42.42.5(pid=11751): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] 20:27:17.891339 run osmo-stp_10.42.42.5(pid=11751): stdout: | (launched: 2022-12-09_20:27:16.285522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:18.021544 run osmo-stp_10.42.42.5(pid=11751): stderr: | 20221209202716591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202716592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202716592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202716592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202716593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202716593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202716593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:18.152043 run osmo-stp_10.42.42.5(pid=11751): stdout: | (launched: 2022-12-09_20:27:16.285522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:18.276665 run osmo-stp_10.42.42.5(pid=11751): stderr: | 20221209202716591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202716592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202716592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202716592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202716593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202716593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202716593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:18.424679 run patchelf(pid=11754): Terminating (SIGINT) 20:27:18.595020 run patchelf(pid=11754): Terminated: ok {rc=0} 20:27:18.717566 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11751): Process ended prematurely: osmo-stp_10.42.42.5(pid=11751) [trial-2364↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] [trial-2364↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 20:27:18.727162 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:27:18.754462 run osmo-hlr_10.42.42.2(pid=11748): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11748)] 20:27:18.802284 run osmo-hlr_10.42.42.2(pid=11748): stdout: | (launched: 2022-12-09_20:27:15.284022) 20:27:18.851277 run osmo-hlr_10.42.42.2(pid=11748): stderr: | 20221209202715457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202715457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202715457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202715457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202715458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202715458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202715469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202715477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202715478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202715478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:18.900840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Terminating (SIGTERM) 20:27:18.940607 run iperf3-srv_10.42.42.10(pid=11742): Terminating (SIGTERM) 20:27:18.980114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11743): Terminating (SIGTERM) 20:27:19.019641 run iperf3-srv_10.42.42.10(pid=11744): Terminating (SIGTERM) 20:27:19.058991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Terminating (SIGTERM) 20:27:19.098539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Terminating (SIGTERM) 20:27:19.138365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11753): Terminating (SIGTERM) 20:27:19.178612 --- ParallelTerminationStrategy: PID 11741 died... 20:27:19.197588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11741): Terminated: ok {rc=0} 20:27:19.241869 --- ParallelTerminationStrategy: PID 11742 died... 20:27:19.260304 run iperf3-srv_10.42.42.10(pid=11742): Terminated {rc=256} 20:27:19.304569 --- ParallelTerminationStrategy: PID 11743 died... 20:27:19.322964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11743): Terminated: ok {rc=0} 20:27:19.366668 --- ParallelTerminationStrategy: PID 11744 died... 20:27:19.384984 run iperf3-srv_10.42.42.10(pid=11744): Terminated {rc=256} 20:27:19.428495 --- ParallelTerminationStrategy: PID 11747 died... 20:27:19.446789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Terminated: ok {rc=0} 20:27:19.490388 --- ParallelTerminationStrategy: PID 11750 died... 20:27:19.508812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Terminated: ok {rc=0} 20:27:19.552596 --- ParallelTerminationStrategy: PID 11753 died... 20:27:19.571180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11753): Terminated: ok {rc=0} 20:27:19.658027 bus /gobi_0: Setting Powered False 20:27:20.757711 bus /gobi_0: Setting Powered False 20:27:21.872321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200 iperf3.py ---------------------------------------------- 20:27:23.018868 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.030209 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:23.082548 tst iperf3.py: using LAC 23517 20:27:23.204253 tst iperf3.py: using RAC 57 20:27:23.332592 tst iperf3.py: using CellId 23517 20:27:23.464326 tst iperf3.py: using BVCI 23518 20:27:23.577119 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.587900 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.598252 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.609087 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.619699 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.630536 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.641300 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.651827 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:23.662528 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:23.783324 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:27:24.004117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:24.330721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11755): Launched 20:27:24.613475 run iperf3-srv_10.42.42.10(pid=11756): Launched 20:27:24.734927 tst iperf3.py:8: start network... 20:27:24.954998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:25.459443 run create_hlr_db(pid=11757): Launched 20:27:25.591939 bus /gobi_6: Setting Powered False 20:27:26.655417 run create_hlr_db(pid=11757): Terminated: ok {rc=0} 20:27:27.087200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11759): Launched 20:27:27.390793 run osmo-hlr_10.42.42.2(pid=11760): Launched 20:27:27.506246 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:28.043660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11762): Launched 20:27:28.346026 run osmo-stp_10.42.42.5(pid=11763): Launched 20:27:28.460778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:28.981500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11765): Launched 20:27:29.097995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:29.354369 run patchelf(pid=11767): Launched 20:27:29.522563 run osmo-stp_10.42.42.5(pid=11763): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11763)] 20:27:29.651053 run osmo-stp_10.42.42.5(pid=11763): stdout: | (launched: 2022-12-09_20:27:28.290474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:29.780220 run osmo-stp_10.42.42.5(pid=11763): stderr: | 20221209202728456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202728456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202728456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202728457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202728457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202728458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202728458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:29.910321 run osmo-stp_10.42.42.5(pid=11763): stdout: | (launched: 2022-12-09_20:27:28.290474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:30.034575 run osmo-stp_10.42.42.5(pid=11763): stderr: | 20221209202728456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202728456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202728456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202728457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202728457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202728458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202728458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:30.182281 run patchelf(pid=11767): Terminating (SIGINT) 20:27:30.351630 run patchelf(pid=11767): Terminated: ok {rc=0} 20:27:30.474451 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11763): Process ended prematurely: osmo-stp_10.42.42.5(pid=11763) [trial-2364↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11763)] [trial-2364↪gprs:trx-b200↪iperf3.py:8] 20:27:30.483859 tst iperf3.py:8: Test FAILED (7.5 sec) 20:27:30.511341 run osmo-hlr_10.42.42.2(pid=11760): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11760)] 20:27:30.558818 run osmo-hlr_10.42.42.2(pid=11760): stdout: | (launched: 2022-12-09_20:27:27.334499) 20:27:30.607969 run osmo-hlr_10.42.42.2(pid=11760): stderr: | 20221209202727508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202727508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202727508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202727508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202727508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202727508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202727520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202727528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202727529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202727529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:30.657457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11755): Terminating (SIGTERM) 20:27:30.696881 run iperf3-srv_10.42.42.10(pid=11756): Terminating (SIGTERM) 20:27:30.736111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11759): Terminating (SIGTERM) 20:27:30.775623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11762): Terminating (SIGTERM) 20:27:30.814902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11765): Terminating (SIGTERM) 20:27:30.854863 --- ParallelTerminationStrategy: PID 11755 died... 20:27:30.876098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11755): Terminated: ok {rc=0} 20:27:30.924496 --- ParallelTerminationStrategy: PID 11756 died... 20:27:30.943290 run iperf3-srv_10.42.42.10(pid=11756): Terminated {rc=256} 20:27:30.987665 --- ParallelTerminationStrategy: PID 11759 died... 20:27:31.006449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11759): Terminated: ok {rc=0} 20:27:31.051094 --- ParallelTerminationStrategy: PID 11762 died... 20:27:31.070110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11762): Terminated: ok {rc=0} 20:27:31.115098 --- ParallelTerminationStrategy: PID 11765 died... 20:27:31.134137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11765): Terminated: ok {rc=0} 20:27:31.220625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 20:27:32.374483 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.386267 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:32.437370 tst iperf3m4.py: using LAC 23518 20:27:32.565612 tst iperf3m4.py: using RAC 58 20:27:32.692825 tst iperf3m4.py: using CellId 23518 20:27:32.821360 tst iperf3m4.py: using BVCI 23519 20:27:32.939974 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.951314 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.962296 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.973078 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.983850 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:32.995164 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:33.006194 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:33.016815 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:33.027724 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:33.145424 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:33.266910 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:33.383392 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:33.503047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:27:33.708229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:34.013149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11768): Launched 20:27:34.278197 run iperf3-srv_10.42.42.10(pid=11769): Launched 20:27:34.391768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:27:34.595413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:34.900263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11770): Launched 20:27:35.164501 run iperf3-srv_10.42.42.10(pid=11771): Launched 20:27:35.278305 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:27:35.481457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:35.786295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11772): Launched 20:27:36.053037 run iperf3-srv_10.42.42.10(pid=11775): Launched 20:27:36.166637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:27:36.369202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:27:36.673341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11776): Launched 20:27:36.937396 run iperf3-srv_10.42.42.10(pid=11777): Launched 20:27:37.050801 tst iperf3m4.py:8: start network... 20:27:37.253839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:37.722748 run create_hlr_db(pid=11778): Launched 20:27:37.839720 bus /gobi_6: Setting Powered False 20:27:38.899570 run create_hlr_db(pid=11778): Terminated: ok {rc=0} 20:27:39.322496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11780): Launched 20:27:39.625910 run osmo-hlr_10.42.42.2(pid=11781): Launched 20:27:39.741864 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:40.268306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11783): Launched 20:27:40.571916 run osmo-stp_10.42.42.5(pid=11784): Launched 20:27:40.687281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:41.210719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11786): Launched 20:27:41.326800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:41.584272 run patchelf(pid=11787): Launched 20:27:41.755075 run osmo-stp_10.42.42.5(pid=11784): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11784)] 20:27:41.885296 run osmo-stp_10.42.42.5(pid=11784): stdout: | (launched: 2022-12-09_20:27:40.516122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:42.016907 run osmo-stp_10.42.42.5(pid=11784): stderr: | 20221209202740685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202740685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202740686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202740686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202740686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202740687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202740687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:42.148551 run osmo-stp_10.42.42.5(pid=11784): stdout: | (launched: 2022-12-09_20:27:40.516122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:42.274968 run osmo-stp_10.42.42.5(pid=11784): stderr: | 20221209202740685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202740685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202740686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202740686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202740686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202740687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202740687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:42.424412 run patchelf(pid=11787): Terminating (SIGINT) 20:27:42.596196 run patchelf(pid=11787): Terminated: ok {rc=0} 20:27:42.720525 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11784): Process ended prematurely: osmo-stp_10.42.42.5(pid=11784) [trial-2364↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11784)] [trial-2364↪gprs:trx-b200↪iperf3m4.py:8] 20:27:42.730280 tst iperf3m4.py:8: Test FAILED (10.4 sec) 20:27:42.758401 run osmo-hlr_10.42.42.2(pid=11781): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11781)] 20:27:42.806443 run osmo-hlr_10.42.42.2(pid=11781): stdout: | (launched: 2022-12-09_20:27:39.570030) 20:27:42.855689 run osmo-hlr_10.42.42.2(pid=11781): stderr: | 20221209202739744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202739744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202739744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202739744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202739744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202739744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202739755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202739764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202739764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202739764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:42.905540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11768): Terminating (SIGTERM) 20:27:42.945315 run iperf3-srv_10.42.42.10(pid=11769): Terminating (SIGTERM) 20:27:42.984712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11770): Terminating (SIGTERM) 20:27:43.024492 run iperf3-srv_10.42.42.10(pid=11771): Terminating (SIGTERM) 20:27:43.064031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11772): Terminating (SIGTERM) 20:27:43.103761 run iperf3-srv_10.42.42.10(pid=11775): Terminating (SIGTERM) 20:27:43.143406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11776): Terminating (SIGTERM) 20:27:43.183099 run iperf3-srv_10.42.42.10(pid=11777): Terminating (SIGTERM) 20:27:43.222704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11780): Terminating (SIGTERM) 20:27:43.262373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11783): Terminating (SIGTERM) 20:27:43.302010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11786): Terminating (SIGTERM) 20:27:43.341958 --- ParallelTerminationStrategy: PID 11768 died... 20:27:43.360790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11768): Terminated: ok {rc=0} 20:27:43.405781 --- ParallelTerminationStrategy: PID 11769 died... 20:27:43.424390 run iperf3-srv_10.42.42.10(pid=11769): Terminated {rc=256} 20:27:43.468440 --- ParallelTerminationStrategy: PID 11770 died... 20:27:43.486917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11770): Terminated: ok {rc=0} 20:27:43.531393 --- ParallelTerminationStrategy: PID 11771 died... 20:27:43.549974 run iperf3-srv_10.42.42.10(pid=11771): Terminated {rc=256} 20:27:43.594074 --- ParallelTerminationStrategy: PID 11772 died... 20:27:43.612600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11772): Terminated: ok {rc=0} 20:27:43.656893 --- ParallelTerminationStrategy: PID 11775 died... 20:27:43.675762 run iperf3-srv_10.42.42.10(pid=11775): Terminated {rc=256} 20:27:43.719750 --- ParallelTerminationStrategy: PID 11776 died... 20:27:43.738293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11776): Terminated: ok {rc=0} 20:27:43.782532 --- ParallelTerminationStrategy: PID 11777 died... 20:27:43.801242 run iperf3-srv_10.42.42.10(pid=11777): Terminated {rc=256} 20:27:43.845423 --- ParallelTerminationStrategy: PID 11780 died... 20:27:43.863873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11780): Terminated: ok {rc=0} 20:27:43.907802 --- ParallelTerminationStrategy: PID 11783 died... 20:27:43.926268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11783): Terminated: ok {rc=0} 20:27:43.970335 --- ParallelTerminationStrategy: PID 11786 died... 20:27:43.989121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11786): Terminated: ok {rc=0} 20:27:44.076132 bus /gobi_4: Setting Powered False 20:27:45.176637 bus /gobi_4: Setting Powered False 20:27:46.290403 bus /gobi_1: Setting Powered False 20:27:47.387877 bus /gobi_1: Setting Powered False 20:27:48.505057 bus /gobi_0: Setting Powered False 20:27:49.603852 bus /gobi_0: Setting Powered False 20:27:50.720837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200 ping.py ---------------------------------------------- 20:27:51.823255 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:51.834515 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:27:51.901921 tst ping.py: using LAC 23519 20:27:52.026338 tst ping.py: using RAC 59 20:27:52.142867 tst ping.py: using CellId 23519 20:27:52.259906 tst ping.py: using BVCI 23520 20:27:52.369835 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.380354 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.390801 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.401656 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.412292 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.422836 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.433579 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:27:52.444217 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:27:52.558766 tst ping.py:19: start network... 20:27:52.760441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:27:53.227559 run create_hlr_db(pid=11788): Launched 20:27:53.341632 bus /gobi_6: Setting Powered False 20:27:54.402116 run create_hlr_db(pid=11788): Terminated: ok {rc=0} 20:27:54.844023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11790): Launched 20:27:55.167978 run osmo-hlr_10.42.42.2(pid=11791): Launched 20:27:55.291021 run osmo-stp_10.42.42.5: Starting osmo-stp 20:27:55.854131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11793): Launched 20:27:56.177983 run osmo-stp_10.42.42.5(pid=11794): Launched 20:27:56.302793 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:27:56.861310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11796): Launched 20:27:56.986067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:27:57.259078 run patchelf(pid=11797): Launched 20:27:57.439332 run osmo-stp_10.42.42.5(pid=11794): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11794)] 20:27:57.576105 run osmo-stp_10.42.42.5(pid=11794): stdout: | (launched: 2022-12-09_20:27:56.118681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:57.714885 run osmo-stp_10.42.42.5(pid=11794): stderr: | 20221209202756311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202756311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202756311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202756312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202756312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202756312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202756312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:57.853821 run osmo-stp_10.42.42.5(pid=11794): stdout: | (launched: 2022-12-09_20:27:56.118681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:27:57.987108 run osmo-stp_10.42.42.5(pid=11794): stderr: | 20221209202756311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202756311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202756311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202756312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202756312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202756312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202756312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:27:58.143836 run patchelf(pid=11797): Terminating (SIGINT) 20:27:58.323940 run patchelf(pid=11797): Terminated: ok {rc=0} 20:27:58.454018 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11794): Process ended prematurely: osmo-stp_10.42.42.5(pid=11794) [trial-2364↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11794)] [trial-2364↪gprs:trx-b200↪ping.py:22] 20:27:58.463967 tst ping.py:22: Test FAILED (6.6 sec) 20:27:58.492401 run osmo-hlr_10.42.42.2(pid=11791): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11791)] 20:27:58.542900 run osmo-hlr_10.42.42.2(pid=11791): stdout: | (launched: 2022-12-09_20:27:55.108694) 20:27:58.595387 run osmo-hlr_10.42.42.2(pid=11791): stderr: | 20221209202755309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202755309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202755309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202755309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202755309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202755309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202755322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202755330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202755330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202755330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:27:58.648054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11790): Terminating (SIGTERM) 20:27:58.690453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11793): Terminating (SIGTERM) 20:27:58.732618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11796): Terminating (SIGTERM) 20:27:58.775292 --- ParallelTerminationStrategy: PID 11790 died... 20:27:58.795402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11790): Terminated: ok {rc=0} 20:27:58.842419 --- ParallelTerminationStrategy: PID 11793 died... 20:27:58.862369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11793): Terminated: ok {rc=0} 20:27:58.908885 --- ParallelTerminationStrategy: PID 11796 died... 20:27:58.929034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11796): Terminated: ok {rc=0} 20:27:59.017851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 20:28:00.104445 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.116460 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 20:28:00.169633 tst ping_idle_ping.py: using LAC 23520 20:28:00.297772 tst ping_idle_ping.py: using RAC 60 20:28:00.426888 tst ping_idle_ping.py: using CellId 23520 20:28:00.556390 tst ping_idle_ping.py: using BVCI 23521 20:28:00.675662 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.687088 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.698072 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.709323 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.720405 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.731369 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.742558 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 20:28:00.753692 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 20:28:00.894393 tst ping_idle_ping.py:24: start network... 20:28:01.120204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:01.632251 run create_hlr_db(pid=11798): Launched 20:28:01.794464 bus /gobi_6: Setting Powered False 20:28:02.858632 run create_hlr_db(pid=11798): Terminated: ok {rc=0} 20:28:03.292497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Launched 20:28:03.594573 run osmo-hlr_10.42.42.2(pid=11801): Launched 20:28:03.708754 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:04.245105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Launched 20:28:04.546217 run osmo-stp_10.42.42.5(pid=11804): Launched 20:28:04.660435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:05.179486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11806): Launched 20:28:05.294171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:05.548398 run patchelf(pid=11807): Launched 20:28:05.715578 run osmo-stp_10.42.42.5(pid=11804): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] 20:28:05.843073 run osmo-stp_10.42.42.5(pid=11804): stdout: | (launched: 2022-12-09_20:28:04.490502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:05.972497 run osmo-stp_10.42.42.5(pid=11804): stderr: | 20221209202804661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202804661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202804661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202804662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202804664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202804664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202804664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:06.102336 run osmo-stp_10.42.42.5(pid=11804): stdout: | (launched: 2022-12-09_20:28:04.490502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:06.225653 run osmo-stp_10.42.42.5(pid=11804): stderr: | 20221209202804661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202804661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202804661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202804662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202804664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202804664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202804664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:06.372331 run patchelf(pid=11807): Terminating (SIGINT) 20:28:06.540803 run patchelf(pid=11807): Terminated: ok {rc=0} 20:28:06.662940 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11804): Process ended prematurely: osmo-stp_10.42.42.5(pid=11804) [trial-2364↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] [trial-2364↪gprs:trx-b200↪ping_idle_ping.py:27] 20:28:06.671982 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:28:06.699139 run osmo-hlr_10.42.42.2(pid=11801): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11801)] 20:28:06.747146 run osmo-hlr_10.42.42.2(pid=11801): stdout: | (launched: 2022-12-09_20:28:03.538772) 20:28:06.796309 run osmo-hlr_10.42.42.2(pid=11801): stderr: | 20221209202803715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202803715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202803715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202803715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202803715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202803715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202803727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202803736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202803737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202803737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:06.846130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Terminating (SIGTERM) 20:28:06.885646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Terminating (SIGTERM) 20:28:06.925035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11806): Terminating (SIGTERM) 20:28:06.964804 --- ParallelTerminationStrategy: PID 11800 died... 20:28:06.983753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11800): Terminated: ok {rc=0} 20:28:07.027907 --- ParallelTerminationStrategy: PID 11803 died... 20:28:07.046387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11803): Terminated: ok {rc=0} 20:28:07.090236 --- ParallelTerminationStrategy: PID 11806 died... 20:28:07.108867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11806): Terminated: ok {rc=0} 20:28:07.192772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 20:28:08.492046 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:28:08.497618 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:28:08.530718 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:28:08.568709 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:28:08.655837 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:28:08.690730 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:28:08.730303 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:28:09.322936 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:28:09.375901 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.387298 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:09.438425 tst cs_paging_gprs_active.py: using LAC 23521 20:28:09.566654 tst cs_paging_gprs_active.py: using RAC 61 20:28:09.696616 tst cs_paging_gprs_active.py: using CellId 23521 20:28:09.826186 tst cs_paging_gprs_active.py: using BVCI 23522 20:28:09.946326 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.957829 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.969223 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.980620 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:09.991974 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:10.003316 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:10.014821 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:10.026016 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:10.037638 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:10.154285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:10.272237 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:28:10.479338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:10.789081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11811): Launched 20:28:11.056085 run iperf3-srv_10.42.42.10(pid=11812): Launched 20:28:11.171328 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:28:11.377277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:11.685731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11813): Launched 20:28:11.953635 run iperf3-srv_10.42.42.10(pid=11814): Launched 20:28:12.069112 tst cs_paging_gprs_active.py:38: start network... 20:28:12.276055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:12.752339 run create_hlr_db(pid=11815): Launched 20:28:12.877698 bus /gobi_6: Setting Powered False 20:28:13.938977 run create_hlr_db(pid=11815): Terminated: ok {rc=0} 20:28:14.387122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11817): Launched 20:28:14.715452 run osmo-hlr_10.42.42.2(pid=11818): Launched 20:28:14.841986 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:15.407168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11820): Launched 20:28:15.735601 run osmo-stp_10.42.42.5(pid=11821): Launched 20:28:15.905828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:16.510963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11823): Launched 20:28:16.646980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:16.919496 run patchelf(pid=11824): Launched 20:28:17.109872 run osmo-stp_10.42.42.5(pid=11821): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11821)] 20:28:17.246189 run osmo-stp_10.42.42.5(pid=11821): stdout: | (launched: 2022-12-09_20:28:15.675400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:17.378720 run osmo-stp_10.42.42.5(pid=11821): stderr: | 20221209202815877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202815878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202815878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202815878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202815879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202815879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202815879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:17.511871 run osmo-stp_10.42.42.5(pid=11821): stdout: | (launched: 2022-12-09_20:28:15.675400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:17.638626 run osmo-stp_10.42.42.5(pid=11821): stderr: | 20221209202815877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202815878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202815878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202815878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202815879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202815879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202815879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:17.789205 run patchelf(pid=11824): Terminating (SIGINT) 20:28:17.961875 run patchelf(pid=11824): Terminated: ok {rc=0} 20:28:18.086296 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11821): Process ended prematurely: osmo-stp_10.42.42.5(pid=11821) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11821)] [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:28:18.096147 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:28:18.124009 run osmo-hlr_10.42.42.2(pid=11818): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11818)] 20:28:18.172451 run osmo-hlr_10.42.42.2(pid=11818): stdout: | (launched: 2022-12-09_20:28:14.655620) 20:28:18.222285 run osmo-hlr_10.42.42.2(pid=11818): stderr: | 20221209202814856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202814856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202814856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202814856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202814856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202814856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202814868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202814876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202814877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202814877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:18.272595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11811): Terminating (SIGTERM) 20:28:18.312598 run iperf3-srv_10.42.42.10(pid=11812): Terminating (SIGTERM) 20:28:18.352433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11813): Terminating (SIGTERM) 20:28:18.392407 run iperf3-srv_10.42.42.10(pid=11814): Terminating (SIGTERM) 20:28:18.432494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11817): Terminating (SIGTERM) 20:28:18.472341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11820): Terminating (SIGTERM) 20:28:18.512080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11823): Terminating (SIGTERM) 20:28:18.552158 --- ParallelTerminationStrategy: PID 11811 died... 20:28:18.571267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11811): Terminated: ok {rc=0} 20:28:18.615476 --- ParallelTerminationStrategy: PID 11812 died... 20:28:18.633994 run iperf3-srv_10.42.42.10(pid=11812): Terminated {rc=256} 20:28:18.678171 --- ParallelTerminationStrategy: PID 11813 died... 20:28:18.696568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11813): Terminated: ok {rc=0} 20:28:18.740454 --- ParallelTerminationStrategy: PID 11814 died... 20:28:18.758878 run iperf3-srv_10.42.42.10(pid=11814): Terminated {rc=256} 20:28:18.802755 --- ParallelTerminationStrategy: PID 11817 died... 20:28:18.821240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11817): Terminated: ok {rc=0} 20:28:18.865446 --- ParallelTerminationStrategy: PID 11820 died... 20:28:18.883952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11820): Terminated: ok {rc=0} 20:28:18.928305 --- ParallelTerminationStrategy: PID 11823 died... 20:28:18.946942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11823): Terminated: ok {rc=0} 20:28:19.032603 bus /gobi_0: Setting Powered False 20:28:20.131828 bus /gobi_0: Setting Powered False 20:28:21.247123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:28:22.393433 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:22.405073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:22.460942 tst iperf3.py: using LAC 23522 20:28:22.581629 tst iperf3.py: using RAC 62 20:28:22.701590 tst iperf3.py: using CellId 23522 20:28:22.829870 tst iperf3.py: using BVCI 23523 20:28:22.949921 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:22.961380 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:22.972491 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:22.984545 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:22.996607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:23.008288 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:23.020085 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:23.031695 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:23.043510 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:23.162006 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:28:23.369114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:23.677369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Launched 20:28:23.946409 run iperf3-srv_10.42.42.10(pid=11826): Launched 20:28:24.061815 tst iperf3.py:8: start network... 20:28:24.267490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:24.743033 run create_hlr_db(pid=11827): Launched 20:28:24.861094 bus /gobi_6: Setting Powered False 20:28:25.921753 run create_hlr_db(pid=11827): Terminated: ok {rc=0} 20:28:26.370858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Launched 20:28:26.700246 run osmo-hlr_10.42.42.2(pid=11830): Launched 20:28:26.825722 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:27.391484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Launched 20:28:27.720024 run osmo-stp_10.42.42.5(pid=11833): Launched 20:28:27.845964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:28.413777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Launched 20:28:28.539936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:28.816881 run patchelf(pid=11836): Launched 20:28:28.999432 run osmo-stp_10.42.42.5(pid=11833): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] 20:28:29.137880 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-09_20:28:27.659224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:29.278089 run osmo-stp_10.42.42.5(pid=11833): stderr: | 20221209202827853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202827853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202827854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202827854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202827855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202827855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202827855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:29.418164 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-09_20:28:27.659224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:29.552395 run osmo-stp_10.42.42.5(pid=11833): stderr: | 20221209202827853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202827853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202827854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202827854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202827855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202827855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202827855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:29.711634 run patchelf(pid=11836): Terminating (SIGINT) 20:28:29.894978 run patchelf(pid=11836): Terminated: ok {rc=0} 20:28:30.027801 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 20:28:30.038227 tst iperf3.py:8: Test FAILED (7.7 sec) 20:28:30.067120 run osmo-hlr_10.42.42.2(pid=11830): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11830)] 20:28:30.117830 run osmo-hlr_10.42.42.2(pid=11830): stdout: | (launched: 2022-12-09_20:28:26.639838) 20:28:30.169730 run osmo-hlr_10.42.42.2(pid=11830): stderr: | 20221209202826839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202826839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202826839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202826839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202826840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202826840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202826854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202826864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202826864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202826864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:30.222183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Terminating (SIGTERM) 20:28:30.263930 run iperf3-srv_10.42.42.10(pid=11826): Terminating (SIGTERM) 20:28:30.305747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminating (SIGTERM) 20:28:30.347607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminating (SIGTERM) 20:28:30.389363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminating (SIGTERM) 20:28:30.431424 --- ParallelTerminationStrategy: PID 11825 died... 20:28:30.451380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11825): Terminated: ok {rc=0} 20:28:30.497432 --- ParallelTerminationStrategy: PID 11826 died... 20:28:30.516699 run iperf3-srv_10.42.42.10(pid=11826): Terminated {rc=256} 20:28:30.562747 --- ParallelTerminationStrategy: PID 11829 died... 20:28:30.582346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminated: ok {rc=0} 20:28:30.628080 --- ParallelTerminationStrategy: PID 11832 died... 20:28:30.648166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminated: ok {rc=0} 20:28:30.694132 --- ParallelTerminationStrategy: PID 11835 died... 20:28:30.713643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminated: ok {rc=0} 20:28:30.801443 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:28:31.977270 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:31.990848 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:32.044334 tst iperf3m4.py: using LAC 23523 20:28:32.212673 tst iperf3m4.py: using RAC 63 20:28:32.345627 tst iperf3m4.py: using CellId 23523 20:28:32.476000 tst iperf3m4.py: using BVCI 23524 20:28:32.597243 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.608468 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.619571 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.630704 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.641830 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.652824 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.664158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.675168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:32.686447 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:32.803886 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:32.925924 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:33.043279 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:33.163716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:28:33.385746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:33.715333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11838): Launched 20:28:34.003180 run iperf3-srv_10.42.42.10(pid=11839): Launched 20:28:34.126314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:28:34.347634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:34.677048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Launched 20:28:34.962360 run iperf3-srv_10.42.42.10(pid=11841): Launched 20:28:35.086456 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:28:35.307850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:35.637357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Launched 20:28:35.922924 run iperf3-srv_10.42.42.10(pid=11843): Launched 20:28:36.047370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:28:36.269240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:28:36.598739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Launched 20:28:36.883802 run iperf3-srv_10.42.42.10(pid=11845): Launched 20:28:37.007057 tst iperf3m4.py:8: start network... 20:28:37.228306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:37.737974 run create_hlr_db(pid=11846): Launched 20:28:37.872008 bus /gobi_6: Setting Powered False 20:28:38.937950 run create_hlr_db(pid=11846): Terminated: ok {rc=0} 20:28:39.395167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Launched 20:28:39.724550 run osmo-hlr_10.42.42.2(pid=11849): Launched 20:28:39.849677 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:40.419789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Launched 20:28:40.749569 run osmo-stp_10.42.42.5(pid=11852): Launched 20:28:40.874250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:41.442303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Launched 20:28:41.568204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:41.845757 run patchelf(pid=11855): Launched 20:28:42.028109 run osmo-stp_10.42.42.5(pid=11852): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] 20:28:42.167202 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-09_20:28:40.689440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:42.307979 run osmo-stp_10.42.42.5(pid=11852): stderr: | 20221209202840881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202840881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202840881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202840882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202840882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202840882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202840882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:42.448149 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-09_20:28:40.689440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:42.582701 run osmo-stp_10.42.42.5(pid=11852): stderr: | 20221209202840881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202840881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202840881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202840882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202840882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202840882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202840882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:42.742600 run patchelf(pid=11855): Terminating (SIGINT) 20:28:42.926461 run patchelf(pid=11855): Terminated: ok {rc=0} 20:28:43.059870 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 20:28:43.070205 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:28:43.099137 run osmo-hlr_10.42.42.2(pid=11849): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11849)] 20:28:43.149569 run osmo-hlr_10.42.42.2(pid=11849): stdout: | (launched: 2022-12-09_20:28:39.664357) 20:28:43.201412 run osmo-hlr_10.42.42.2(pid=11849): stderr: | 20221209202839861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202839861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202839861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202839861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202839862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202839862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202839874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202839883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202839883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202839883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:43.253603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11838): Terminating (SIGTERM) 20:28:43.295152 run iperf3-srv_10.42.42.10(pid=11839): Terminating (SIGTERM) 20:28:43.336804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Terminating (SIGTERM) 20:28:43.378608 run iperf3-srv_10.42.42.10(pid=11841): Terminating (SIGTERM) 20:28:43.420223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Terminating (SIGTERM) 20:28:43.461954 run iperf3-srv_10.42.42.10(pid=11843): Terminating (SIGTERM) 20:28:43.503618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Terminating (SIGTERM) 20:28:43.545352 run iperf3-srv_10.42.42.10(pid=11845): Terminating (SIGTERM) 20:28:43.586917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminating (SIGTERM) 20:28:43.628718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminating (SIGTERM) 20:28:43.670486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Terminating (SIGTERM) 20:28:43.712547 --- ParallelTerminationStrategy: PID 11838 died... 20:28:43.732621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11838): Terminated: ok {rc=0} 20:28:43.778852 --- ParallelTerminationStrategy: PID 11839 died... 20:28:43.798367 run iperf3-srv_10.42.42.10(pid=11839): Terminated {rc=256} 20:28:43.844185 --- ParallelTerminationStrategy: PID 11840 died... 20:28:43.863576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11840): Terminated: ok {rc=0} 20:28:43.909346 --- ParallelTerminationStrategy: PID 11841 died... 20:28:43.928804 run iperf3-srv_10.42.42.10(pid=11841): Terminated {rc=256} 20:28:43.975003 --- ParallelTerminationStrategy: PID 11842 died... 20:28:43.994628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Terminated: ok {rc=0} 20:28:44.040775 --- ParallelTerminationStrategy: PID 11843 died... 20:28:44.060207 run iperf3-srv_10.42.42.10(pid=11843): Terminated {rc=256} 20:28:44.106088 --- ParallelTerminationStrategy: PID 11844 died... 20:28:44.125451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Terminated: ok {rc=0} 20:28:44.171597 --- ParallelTerminationStrategy: PID 11845 died... 20:28:44.191431 run iperf3-srv_10.42.42.10(pid=11845): Terminated {rc=256} 20:28:44.237508 --- ParallelTerminationStrategy: PID 11848 died... 20:28:44.256842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminated: ok {rc=0} 20:28:44.302924 --- ParallelTerminationStrategy: PID 11851 died... 20:28:44.322488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminated: ok {rc=0} 20:28:44.368262 --- ParallelTerminationStrategy: PID 11854 died... 20:28:44.387637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Terminated: ok {rc=0} 20:28:44.474690 bus /gobi_4: Setting Powered False 20:28:45.574193 bus /gobi_4: Setting Powered False 20:28:46.693607 bus /gobi_1: Setting Powered False 20:28:47.791234 bus /gobi_1: Setting Powered False 20:28:48.907287 bus /gobi_0: Setting Powered False 20:28:50.005908 bus /gobi_0: Setting Powered False 20:28:51.123451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 20:28:52.227247 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.238984 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:28:52.289738 tst ping.py: using LAC 23524 20:28:52.410987 tst ping.py: using RAC 64 20:28:52.532036 tst ping.py: using CellId 23524 20:28:52.651760 tst ping.py: using BVCI 23525 20:28:52.761394 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.772238 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.782966 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.793831 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.804652 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.815540 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.826651 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:28:52.837603 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:28:52.957218 tst ping.py:19: start network... 20:28:53.174958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:28:53.675152 run create_hlr_db(pid=11856): Launched 20:28:53.807717 bus /gobi_6: Setting Powered False 20:28:54.872816 run create_hlr_db(pid=11856): Terminated: ok {rc=0} 20:28:55.306056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Launched 20:28:55.609246 run osmo-hlr_10.42.42.2(pid=11859): Launched 20:28:55.723600 run osmo-stp_10.42.42.5: Starting osmo-stp 20:28:56.248340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Launched 20:28:56.550196 run osmo-stp_10.42.42.5(pid=11862): Launched 20:28:56.666798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:28:57.184940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11864): Launched 20:28:57.300717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:28:57.555337 run patchelf(pid=11865): Launched 20:28:57.721894 run osmo-stp_10.42.42.5(pid=11862): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] 20:28:57.849243 run osmo-stp_10.42.42.5(pid=11862): stdout: | (launched: 2022-12-09_20:28:56.494407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:57.978231 run osmo-stp_10.42.42.5(pid=11862): stderr: | 20221209202856666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202856666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202856666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202856667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202856667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202856667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202856667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:58.107546 run osmo-stp_10.42.42.5(pid=11862): stdout: | (launched: 2022-12-09_20:28:56.494407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:28:58.230843 run osmo-stp_10.42.42.5(pid=11862): stderr: | 20221209202856666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202856666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202856666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202856667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202856667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202856667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202856667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:28:58.377516 run patchelf(pid=11865): Terminating (SIGINT) 20:28:58.546519 run patchelf(pid=11865): Terminated: ok {rc=0} 20:28:58.668405 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11862): Process ended prematurely: osmo-stp_10.42.42.5(pid=11862) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 20:28:58.677530 tst ping.py:22: Test FAILED (6.4 sec) 20:28:58.704666 run osmo-hlr_10.42.42.2(pid=11859): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11859)] 20:28:58.752830 run osmo-hlr_10.42.42.2(pid=11859): stdout: | (launched: 2022-12-09_20:28:55.553559) 20:28:58.802629 run osmo-hlr_10.42.42.2(pid=11859): stderr: | 20221209202855732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202855732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202855732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202855732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202855732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202855732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202855744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202855753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202855753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202855754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:28:58.852741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Terminating (SIGTERM) 20:28:58.892440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Terminating (SIGTERM) 20:28:58.931896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11864): Terminating (SIGTERM) 20:28:58.971938 --- ParallelTerminationStrategy: PID 11858 died... 20:28:58.990910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11858): Terminated: ok {rc=0} 20:28:59.035273 --- ParallelTerminationStrategy: PID 11861 died... 20:28:59.053910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11861): Terminated: ok {rc=0} 20:28:59.098765 --- ParallelTerminationStrategy: PID 11864 died... 20:28:59.117328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11864): Terminated: ok {rc=0} 20:28:59.203372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:29:00.292067 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.304205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:29:00.356063 tst ping_idle_ping.py: using LAC 23525 20:29:00.475904 tst ping_idle_ping.py: using RAC 65 20:29:00.595913 tst ping_idle_ping.py: using CellId 23525 20:29:00.715846 tst ping_idle_ping.py: using BVCI 23526 20:29:00.826780 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.838781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.862112 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.879533 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.903789 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.919886 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.937172 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:29:00.948836 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:29:01.083356 tst ping_idle_ping.py:24: start network... 20:29:01.307230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:01.787267 run create_hlr_db(pid=11866): Launched 20:29:01.940634 bus /gobi_6: Setting Powered False 20:29:03.001614 run create_hlr_db(pid=11866): Terminated: ok {rc=0} 20:29:03.446052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11868): Launched 20:29:03.772065 run osmo-hlr_10.42.42.2(pid=11869): Launched 20:29:03.896506 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:04.459566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11871): Launched 20:29:04.784107 run osmo-stp_10.42.42.5(pid=11872): Launched 20:29:04.907240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:05.433208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11874): Launched 20:29:05.549559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:05.806062 run patchelf(pid=11875): Launched 20:29:05.974092 run osmo-stp_10.42.42.5(pid=11872): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11872)] 20:29:06.102542 run osmo-stp_10.42.42.5(pid=11872): stdout: | (launched: 2022-12-09_20:29:04.724753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:06.232438 run osmo-stp_10.42.42.5(pid=11872): stderr: | 20221209202904898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202904898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202904899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202904899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202904900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202904900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202904900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:06.363181 run osmo-stp_10.42.42.5(pid=11872): stdout: | (launched: 2022-12-09_20:29:04.724753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:06.487406 run osmo-stp_10.42.42.5(pid=11872): stderr: | 20221209202904898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202904898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202904899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202904899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202904900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202904900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202904900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:06.634467 run patchelf(pid=11875): Terminating (SIGINT) 20:29:06.804717 run patchelf(pid=11875): Terminated: ok {rc=0} 20:29:06.927154 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11872): Process ended prematurely: osmo-stp_10.42.42.5(pid=11872) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11872)] [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 20:29:06.936176 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:29:06.963433 run osmo-hlr_10.42.42.2(pid=11869): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11869)] 20:29:07.012022 run osmo-hlr_10.42.42.2(pid=11869): stdout: | (launched: 2022-12-09_20:29:03.712383) 20:29:07.062100 run osmo-hlr_10.42.42.2(pid=11869): stderr: | 20221209202903913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202903913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202903913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202903913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202903913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202903913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202903925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202903933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202903933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202903933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:07.112650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11868): Terminating (SIGTERM) 20:29:07.152912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11871): Terminating (SIGTERM) 20:29:07.193078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11874): Terminating (SIGTERM) 20:29:07.233277 --- ParallelTerminationStrategy: PID 11868 died... 20:29:07.252316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11868): Terminated: ok {rc=0} 20:29:07.296763 --- ParallelTerminationStrategy: PID 11871 died... 20:29:07.315464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11871): Terminated: ok {rc=0} 20:29:07.359777 --- ParallelTerminationStrategy: PID 11874 died... 20:29:07.378443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11874): Terminated: ok {rc=0} 20:29:07.462931 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:29:08.774486 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:29:08.781316 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:29:08.816888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:29:08.856586 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:29:08.948767 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:29:08.983865 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:29:09.022249 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:29:09.609371 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:29:09.659180 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:09.670216 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:09.736922 tst cs_paging_gprs_active.py: using LAC 23526 20:29:09.855477 tst cs_paging_gprs_active.py: using RAC 66 20:29:09.974327 tst cs_paging_gprs_active.py: using CellId 23526 20:29:10.094101 tst cs_paging_gprs_active.py: using BVCI 23527 20:29:10.207128 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.217955 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.228590 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.239539 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.250390 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.261361 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.272414 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.283504 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:10.294678 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:10.411560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:10.532615 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:29:10.756516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:11.087502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11879): Launched 20:29:11.375902 run iperf3-srv_10.42.42.10(pid=11880): Launched 20:29:11.499208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:29:11.722634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:12.053861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11881): Launched 20:29:12.339129 run iperf3-srv_10.42.42.10(pid=11882): Launched 20:29:12.462426 tst cs_paging_gprs_active.py:38: start network... 20:29:12.683839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:13.193618 run create_hlr_db(pid=11883): Launched 20:29:13.326959 bus /gobi_6: Setting Powered False 20:29:14.391375 run create_hlr_db(pid=11883): Terminated: ok {rc=0} 20:29:14.828030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Launched 20:29:15.135808 run osmo-hlr_10.42.42.2(pid=11886): Launched 20:29:15.252934 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:15.784501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Launched 20:29:16.103601 run osmo-stp_10.42.42.5(pid=11889): Launched 20:29:16.280462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:16.992220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11891): Launched 20:29:17.123922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:17.387566 run patchelf(pid=11892): Launched 20:29:17.558621 run osmo-stp_10.42.42.5(pid=11889): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] 20:29:17.689169 run osmo-stp_10.42.42.5(pid=11889): stdout: | (launched: 2022-12-09_20:29:16.046576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:17.820649 run osmo-stp_10.42.42.5(pid=11889): stderr: | 20221209202916374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202916375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202916377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202916379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202916381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202916383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202916383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:17.952301 run osmo-stp_10.42.42.5(pid=11889): stdout: | (launched: 2022-12-09_20:29:16.046576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:18.078801 run osmo-stp_10.42.42.5(pid=11889): stderr: | 20221209202916374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202916375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202916377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202916379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202916381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202916383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202916383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:18.227945 run patchelf(pid=11892): Terminating (SIGINT) 20:29:18.400177 run patchelf(pid=11892): Terminated: ok {rc=0} 20:29:18.525346 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11889): Process ended prematurely: osmo-stp_10.42.42.5(pid=11889) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:29:18.534942 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:29:18.562756 run osmo-hlr_10.42.42.2(pid=11886): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11886)] 20:29:18.610618 run osmo-hlr_10.42.42.2(pid=11886): stdout: | (launched: 2022-12-09_20:29:15.079202) 20:29:18.660225 run osmo-hlr_10.42.42.2(pid=11886): stderr: | 20221209202915255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202915255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202915255 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202915255 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202915255 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202915255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202915268 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202915278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202915278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202915278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:18.710224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11879): Terminating (SIGTERM) 20:29:18.750081 run iperf3-srv_10.42.42.10(pid=11880): Terminating (SIGTERM) 20:29:18.789872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11881): Terminating (SIGTERM) 20:29:18.829838 run iperf3-srv_10.42.42.10(pid=11882): Terminating (SIGTERM) 20:29:18.869570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Terminating (SIGTERM) 20:29:18.909361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Terminating (SIGTERM) 20:29:18.949196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11891): Terminating (SIGTERM) 20:29:18.989811 --- ParallelTerminationStrategy: PID 11879 died... 20:29:19.008516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11879): Terminated: ok {rc=0} 20:29:19.052705 --- ParallelTerminationStrategy: PID 11880 died... 20:29:19.071189 run iperf3-srv_10.42.42.10(pid=11880): Terminated {rc=256} 20:29:19.115220 --- ParallelTerminationStrategy: PID 11881 died... 20:29:19.133700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11881): Terminated: ok {rc=0} 20:29:19.177515 --- ParallelTerminationStrategy: PID 11882 died... 20:29:19.195809 run iperf3-srv_10.42.42.10(pid=11882): Terminated {rc=256} 20:29:19.239644 --- ParallelTerminationStrategy: PID 11885 died... 20:29:19.258167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Terminated: ok {rc=0} 20:29:19.302376 --- ParallelTerminationStrategy: PID 11888 died... 20:29:19.320817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Terminated: ok {rc=0} 20:29:19.364685 --- ParallelTerminationStrategy: PID 11891 died... 20:29:19.383341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11891): Terminated: ok {rc=0} 20:29:19.467461 bus /gobi_0: Setting Powered False 20:29:20.565947 bus /gobi_0: Setting Powered False 20:29:21.681773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:29:22.831106 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:22.843123 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:22.916636 tst iperf3.py: using LAC 23527 20:29:23.045117 tst iperf3.py: using RAC 67 20:29:23.174829 tst iperf3.py: using CellId 23527 20:29:23.303638 tst iperf3.py: using BVCI 23528 20:29:23.424422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.435796 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.446929 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.458119 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.469131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.480762 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.491978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.503061 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:23.514353 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:23.630952 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:29:23.837879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:24.146280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Launched 20:29:24.416057 run iperf3-srv_10.42.42.10(pid=11894): Launched 20:29:24.532521 tst iperf3.py:8: start network... 20:29:24.738540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:25.213608 run create_hlr_db(pid=11895): Launched 20:29:25.330814 bus /gobi_6: Setting Powered False 20:29:26.391607 run create_hlr_db(pid=11895): Terminated: ok {rc=0} 20:29:26.840182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11897): Launched 20:29:27.169983 run osmo-hlr_10.42.42.2(pid=11898): Launched 20:29:27.295095 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:27.865198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11900): Launched 20:29:28.193213 run osmo-stp_10.42.42.5(pid=11901): Launched 20:29:28.317897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:28.886324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11903): Launched 20:29:29.011565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:29.289237 run patchelf(pid=11904): Launched 20:29:29.471006 run osmo-stp_10.42.42.5(pid=11901): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11901)] 20:29:29.609638 run osmo-stp_10.42.42.5(pid=11901): stdout: | (launched: 2022-12-09_20:29:28.133335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:29.749607 run osmo-stp_10.42.42.5(pid=11901): stderr: | 20221209202928326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202928326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202928326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202928327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202928327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202928327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202928327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:29.889645 run osmo-stp_10.42.42.5(pid=11901): stdout: | (launched: 2022-12-09_20:29:28.133335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:30.024451 run osmo-stp_10.42.42.5(pid=11901): stderr: | 20221209202928326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202928326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202928326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202928327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202928327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202928327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202928327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:30.183651 run patchelf(pid=11904): Terminating (SIGINT) 20:29:30.366905 run patchelf(pid=11904): Terminated: ok {rc=0} 20:29:30.499365 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11901): Process ended prematurely: osmo-stp_10.42.42.5(pid=11901) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11901)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 20:29:30.509708 tst iperf3.py:8: Test FAILED (7.7 sec) 20:29:30.538741 run osmo-hlr_10.42.42.2(pid=11898): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11898)] 20:29:30.589333 run osmo-hlr_10.42.42.2(pid=11898): stdout: | (launched: 2022-12-09_20:29:27.109660) 20:29:30.641602 run osmo-hlr_10.42.42.2(pid=11898): stderr: | 20221209202927311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202927311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202927311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202927311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202927311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202927311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202927324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202927332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202927332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202927332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:30.694476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Terminating (SIGTERM) 20:29:30.736487 run iperf3-srv_10.42.42.10(pid=11894): Terminating (SIGTERM) 20:29:30.778563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11897): Terminating (SIGTERM) 20:29:30.820624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11900): Terminating (SIGTERM) 20:29:30.873744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11903): Terminating (SIGTERM) 20:29:30.933749 --- ParallelTerminationStrategy: PID 11893 died... 20:29:30.954245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11893): Terminated: ok {rc=0} 20:29:31.003550 --- ParallelTerminationStrategy: PID 11894 died... 20:29:31.023975 run iperf3-srv_10.42.42.10(pid=11894): Terminated {rc=256} 20:29:31.072890 --- ParallelTerminationStrategy: PID 11897 died... 20:29:31.093737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11897): Terminated: ok {rc=0} 20:29:31.141985 --- ParallelTerminationStrategy: PID 11900 died... 20:29:31.162253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11900): Terminated: ok {rc=0} 20:29:31.209542 --- ParallelTerminationStrategy: PID 11903 died... 20:29:31.229840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11903): Terminated: ok {rc=0} 20:29:31.319599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:29:32.472283 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:32.484368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:32.555834 tst iperf3m4.py: using LAC 23528 20:29:32.686584 tst iperf3m4.py: using RAC 68 20:29:32.815813 tst iperf3m4.py: using CellId 23528 20:29:32.944109 tst iperf3m4.py: using BVCI 23529 20:29:33.065289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.076598 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.087737 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.099018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.110048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.121188 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.132351 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.143377 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:33.154636 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:33.272554 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:33.396334 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:33.513153 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:33.631922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:29:33.839052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:34.147498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11905): Launched 20:29:34.416318 run iperf3-srv_10.42.42.10(pid=11906): Launched 20:29:34.531867 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:29:34.738178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:35.046908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Launched 20:29:35.314490 run iperf3-srv_10.42.42.10(pid=11908): Launched 20:29:35.429530 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:29:35.635582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:35.943978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11909): Launched 20:29:36.211364 run iperf3-srv_10.42.42.10(pid=11910): Launched 20:29:36.326569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:29:36.532718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:29:36.841931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11911): Launched 20:29:37.109363 run iperf3-srv_10.42.42.10(pid=11912): Launched 20:29:37.224331 tst iperf3m4.py:8: start network... 20:29:37.430326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:37.906966 run create_hlr_db(pid=11913): Launched 20:29:38.025643 bus /gobi_6: Setting Powered False 20:29:39.086903 run create_hlr_db(pid=11913): Terminated: ok {rc=0} 20:29:39.514952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11915): Launched 20:29:39.821023 run osmo-hlr_10.42.42.2(pid=11916): Launched 20:29:39.937212 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:40.476020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11918): Launched 20:29:40.782621 run osmo-stp_10.42.42.5(pid=11919): Launched 20:29:40.899663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:41.429192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11921): Launched 20:29:41.546654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:41.806078 run patchelf(pid=11922): Launched 20:29:41.976171 run osmo-stp_10.42.42.5(pid=11919): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11919)] 20:29:42.106209 run osmo-stp_10.42.42.5(pid=11919): stdout: | (launched: 2022-12-09_20:29:40.726167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:42.237300 run osmo-stp_10.42.42.5(pid=11919): stderr: | 20221209202940895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202940895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202940896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202940896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202940896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202940897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202940897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:42.368616 run osmo-stp_10.42.42.5(pid=11919): stdout: | (launched: 2022-12-09_20:29:40.726167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:42.494241 run osmo-stp_10.42.42.5(pid=11919): stderr: | 20221209202940895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202940895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202940896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202940896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202940896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202940897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202940897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:42.643245 run patchelf(pid=11922): Terminating (SIGINT) 20:29:42.815443 run patchelf(pid=11922): Terminated: ok {rc=0} 20:29:42.939958 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11919): Process ended prematurely: osmo-stp_10.42.42.5(pid=11919) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11919)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:29:42.949696 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:29:42.977779 run osmo-hlr_10.42.42.2(pid=11916): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11916)] 20:29:43.025669 run osmo-hlr_10.42.42.2(pid=11916): stdout: | (launched: 2022-12-09_20:29:39.764247) 20:29:43.075067 run osmo-hlr_10.42.42.2(pid=11916): stderr: | 20221209202939941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202939941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202939941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202939941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202939941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202939941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202939955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202939964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202939964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202939964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:43.124831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11905): Terminating (SIGTERM) 20:29:43.164431 run iperf3-srv_10.42.42.10(pid=11906): Terminating (SIGTERM) 20:29:43.203880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Terminating (SIGTERM) 20:29:43.243513 run iperf3-srv_10.42.42.10(pid=11908): Terminating (SIGTERM) 20:29:43.282894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11909): Terminating (SIGTERM) 20:29:43.322295 run iperf3-srv_10.42.42.10(pid=11910): Terminating (SIGTERM) 20:29:43.361735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11911): Terminating (SIGTERM) 20:29:43.401303 run iperf3-srv_10.42.42.10(pid=11912): Terminating (SIGTERM) 20:29:43.440601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11915): Terminating (SIGTERM) 20:29:43.479873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11918): Terminating (SIGTERM) 20:29:43.519262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11921): Terminating (SIGTERM) 20:29:43.559305 --- ParallelTerminationStrategy: PID 11905 died... 20:29:43.578324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11905): Terminated: ok {rc=0} 20:29:43.622949 --- ParallelTerminationStrategy: PID 11906 died... 20:29:43.641523 run iperf3-srv_10.42.42.10(pid=11906): Terminated {rc=256} 20:29:43.685690 --- ParallelTerminationStrategy: PID 11907 died... 20:29:43.704176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11907): Terminated: ok {rc=0} 20:29:43.748781 --- ParallelTerminationStrategy: PID 11908 died... 20:29:43.767357 run iperf3-srv_10.42.42.10(pid=11908): Terminated {rc=256} 20:29:43.811195 --- ParallelTerminationStrategy: PID 11909 died... 20:29:43.829663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11909): Terminated: ok {rc=0} 20:29:43.873402 --- ParallelTerminationStrategy: PID 11910 died... 20:29:43.891753 run iperf3-srv_10.42.42.10(pid=11910): Terminated {rc=256} 20:29:43.935543 --- ParallelTerminationStrategy: PID 11911 died... 20:29:43.953961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11911): Terminated: ok {rc=0} 20:29:43.997915 --- ParallelTerminationStrategy: PID 11912 died... 20:29:44.016307 run iperf3-srv_10.42.42.10(pid=11912): Terminated {rc=256} 20:29:44.060870 --- ParallelTerminationStrategy: PID 11915 died... 20:29:44.079782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11915): Terminated: ok {rc=0} 20:29:44.123979 --- ParallelTerminationStrategy: PID 11918 died... 20:29:44.142525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11918): Terminated: ok {rc=0} 20:29:44.186489 --- ParallelTerminationStrategy: PID 11921 died... 20:29:44.205131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11921): Terminated: ok {rc=0} 20:29:44.289327 bus /gobi_4: Setting Powered False 20:29:45.387811 bus /gobi_4: Setting Powered False 20:29:46.503032 bus /gobi_1: Setting Powered False 20:29:47.601747 bus /gobi_1: Setting Powered False 20:29:48.716882 bus /gobi_0: Setting Powered False 20:29:49.820091 bus /gobi_0: Setting Powered False 20:29:50.936598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:29:52.036746 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.048250 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:29:52.117584 tst ping.py: using LAC 23529 20:29:52.246534 tst ping.py: using RAC 69 20:29:52.373848 tst ping.py: using CellId 23529 20:29:52.501954 tst ping.py: using BVCI 23530 20:29:52.620296 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.631858 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.643187 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.654832 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.666383 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.678072 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.689871 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:29:52.701505 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:29:52.821465 tst ping.py:19: start network... 20:29:53.039834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:29:53.540440 run create_hlr_db(pid=11923): Launched 20:29:53.672294 bus /gobi_6: Setting Powered False 20:29:54.736597 run create_hlr_db(pid=11923): Terminated: ok {rc=0} 20:29:55.168938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11925): Launched 20:29:55.471516 run osmo-hlr_10.42.42.2(pid=11926): Launched 20:29:55.587935 run osmo-stp_10.42.42.5: Starting osmo-stp 20:29:56.124716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11928): Launched 20:29:56.426861 run osmo-stp_10.42.42.5(pid=11929): Launched 20:29:56.542303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:29:57.062809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11931): Launched 20:29:57.179662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:29:57.433680 run patchelf(pid=11932): Launched 20:29:57.600850 run osmo-stp_10.42.42.5(pid=11929): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11929)] 20:29:57.728678 run osmo-stp_10.42.42.5(pid=11929): stdout: | (launched: 2022-12-09_20:29:56.371366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:57.858148 run osmo-stp_10.42.42.5(pid=11929): stderr: | 20221209202956542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202956542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202956542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202956543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202956543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202956543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202956543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:57.987948 run osmo-stp_10.42.42.5(pid=11929): stdout: | (launched: 2022-12-09_20:29:56.371366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:29:58.111693 run osmo-stp_10.42.42.5(pid=11929): stderr: | 20221209202956542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209202956542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209202956542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209202956543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209202956543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209202956543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209202956543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:29:58.258247 run patchelf(pid=11932): Terminating (SIGINT) 20:29:58.427384 run patchelf(pid=11932): Terminated: ok {rc=0} 20:29:58.548804 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11929): Process ended prematurely: osmo-stp_10.42.42.5(pid=11929) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11929)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 20:29:58.558018 tst ping.py:22: Test FAILED (6.5 sec) 20:29:58.585636 run osmo-hlr_10.42.42.2(pid=11926): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11926)] 20:29:58.634000 run osmo-hlr_10.42.42.2(pid=11926): stdout: | (launched: 2022-12-09_20:29:55.415980) 20:29:58.684061 run osmo-hlr_10.42.42.2(pid=11926): stderr: | 20221209202955592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209202955592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209202955592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209202955592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209202955592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209202955592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209202955603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209202955612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209202955612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209202955612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:29:58.734823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11925): Terminating (SIGTERM) 20:29:58.775389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11928): Terminating (SIGTERM) 20:29:58.815435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11931): Terminating (SIGTERM) 20:29:58.855936 --- ParallelTerminationStrategy: PID 11925 died... 20:29:58.875202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11925): Terminated: ok {rc=0} 20:29:58.919913 --- ParallelTerminationStrategy: PID 11928 died... 20:29:58.938596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11928): Terminated: ok {rc=0} 20:29:58.983043 --- ParallelTerminationStrategy: PID 11931 died... 20:29:59.001754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11931): Terminated: ok {rc=0} 20:29:59.088140 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:30:00.177139 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.189253 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:30:00.260343 tst ping_idle_ping.py: using LAC 23530 20:30:00.391271 tst ping_idle_ping.py: using RAC 70 20:30:00.521523 tst ping_idle_ping.py: using CellId 23530 20:30:00.642022 tst ping_idle_ping.py: using BVCI 23531 20:30:00.754103 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.765066 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.775933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.787179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.798135 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.809118 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.820195 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:30:00.831380 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:30:00.980441 tst ping_idle_ping.py:24: start network... 20:30:01.198423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:01.692677 run create_hlr_db(pid=11936): Launched 20:30:01.858503 bus /gobi_6: Setting Powered False 20:30:02.921477 run create_hlr_db(pid=11936): Terminated: ok {rc=0} 20:30:03.361338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11938): Launched 20:30:03.663962 run osmo-hlr_10.42.42.2(pid=11939): Launched 20:30:03.779235 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:04.310953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11941): Launched 20:30:04.612080 run osmo-stp_10.42.42.5(pid=11942): Launched 20:30:04.726814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:05.262742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11944): Launched 20:30:05.379411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:05.634244 run patchelf(pid=11945): Launched 20:30:05.803474 run osmo-stp_10.42.42.5(pid=11942): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11942)] 20:30:05.930863 run osmo-stp_10.42.42.5(pid=11942): stdout: | (launched: 2022-12-09_20:30:04.556702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:06.060437 run osmo-stp_10.42.42.5(pid=11942): stderr: | 20221209203004727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203004727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203004727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203004727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203004728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203004728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203004728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:06.190347 run osmo-stp_10.42.42.5(pid=11942): stdout: | (launched: 2022-12-09_20:30:04.556702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:06.313798 run osmo-stp_10.42.42.5(pid=11942): stderr: | 20221209203004727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203004727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203004727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203004727 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203004728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203004728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203004728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:06.459621 run patchelf(pid=11945): Terminating (SIGINT) 20:30:06.627879 run patchelf(pid=11945): Terminated: ok {rc=0} 20:30:06.749238 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11942): Process ended prematurely: osmo-stp_10.42.42.5(pid=11942) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11942)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:30:06.758617 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:30:06.785883 run osmo-hlr_10.42.42.2(pid=11939): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11939)] 20:30:06.834342 run osmo-hlr_10.42.42.2(pid=11939): stdout: | (launched: 2022-12-09_20:30:03.607834) 20:30:06.884154 run osmo-hlr_10.42.42.2(pid=11939): stderr: | 20221209203003784 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203003784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203003784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203003784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203003784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203003784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203003795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203003803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203003803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203003803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:06.934159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11938): Terminating (SIGTERM) 20:30:06.973855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11941): Terminating (SIGTERM) 20:30:07.013833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11944): Terminating (SIGTERM) 20:30:07.053849 --- ParallelTerminationStrategy: PID 11938 died... 20:30:07.072781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11938): Terminated: ok {rc=0} 20:30:07.116801 --- ParallelTerminationStrategy: PID 11941 died... 20:30:07.135693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11941): Terminated: ok {rc=0} 20:30:07.179584 --- ParallelTerminationStrategy: PID 11944 died... 20:30:07.198121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11944): Terminated: ok {rc=0} 20:30:07.283579 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:30:08.587953 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:30:08.594105 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:30:08.627537 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:30:08.665731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:30:08.751751 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:30:08.784666 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:30:08.822568 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:30:09.416937 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:30:09.466632 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:09.477556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:09.546437 tst cs_paging_gprs_active.py: using LAC 23531 20:30:09.671137 tst cs_paging_gprs_active.py: using RAC 71 20:30:09.791052 tst cs_paging_gprs_active.py: using CellId 23531 20:30:09.912231 tst cs_paging_gprs_active.py: using BVCI 23532 20:30:10.023787 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.034712 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.045385 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.067648 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.079880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.091316 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.103368 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.115100 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:10.126877 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:10.248874 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:10.372584 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:30:10.583002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:10.894075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11949): Launched 20:30:11.165227 run iperf3-srv_10.42.42.10(pid=11950): Launched 20:30:11.280488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:30:11.487797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:11.796516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11951): Launched 20:30:12.064854 run iperf3-srv_10.42.42.10(pid=11952): Launched 20:30:12.180219 tst cs_paging_gprs_active.py:38: start network... 20:30:12.387591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:12.865499 run create_hlr_db(pid=11953): Launched 20:30:12.982651 bus /gobi_6: Setting Powered False 20:30:14.043411 run create_hlr_db(pid=11953): Terminated: ok {rc=0} 20:30:14.470772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11955): Launched 20:30:14.777747 run osmo-hlr_10.42.42.2(pid=11956): Launched 20:30:14.894678 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:15.420665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11958): Launched 20:30:15.727714 run osmo-stp_10.42.42.5(pid=11959): Launched 20:30:15.886878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:16.505780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11961): Launched 20:30:16.633444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:16.929276 run patchelf(pid=11962): Launched 20:30:17.126536 run osmo-stp_10.42.42.5(pid=11959): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11959)] 20:30:17.269674 run osmo-stp_10.42.42.5(pid=11959): stdout: | (launched: 2022-12-09_20:30:15.671351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:17.411836 run osmo-stp_10.42.42.5(pid=11959): stderr: | 20221209203015841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203015841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203015842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203015842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203015842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203015843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203015843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:17.552345 run osmo-stp_10.42.42.5(pid=11959): stdout: | (launched: 2022-12-09_20:30:15.671351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:17.687388 run osmo-stp_10.42.42.5(pid=11959): stderr: | 20221209203015841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203015841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203015842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203015842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203015842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203015843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203015843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:17.847093 run patchelf(pid=11962): Terminating (SIGINT) 20:30:18.032317 run patchelf(pid=11962): Terminated: ok {rc=0} 20:30:18.166009 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11959): Process ended prematurely: osmo-stp_10.42.42.5(pid=11959) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11959)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:30:18.176593 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:30:18.205676 run osmo-hlr_10.42.42.2(pid=11956): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11956)] 20:30:18.256192 run osmo-hlr_10.42.42.2(pid=11956): stdout: | (launched: 2022-12-09_20:30:14.720760) 20:30:18.308585 run osmo-hlr_10.42.42.2(pid=11956): stderr: | 20221209203014900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203014900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203014900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203014900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203014900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203014900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203014912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203014921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203014921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203014921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:18.361336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11949): Terminating (SIGTERM) 20:30:18.403989 run iperf3-srv_10.42.42.10(pid=11950): Terminating (SIGTERM) 20:30:18.445876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11951): Terminating (SIGTERM) 20:30:18.487885 run iperf3-srv_10.42.42.10(pid=11952): Terminating (SIGTERM) 20:30:18.529812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11955): Terminating (SIGTERM) 20:30:18.571693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11958): Terminating (SIGTERM) 20:30:18.613654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11961): Terminating (SIGTERM) 20:30:18.655942 --- ParallelTerminationStrategy: PID 11949 died... 20:30:18.676049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11949): Terminated: ok {rc=0} 20:30:18.722795 --- ParallelTerminationStrategy: PID 11950 died... 20:30:18.742481 run iperf3-srv_10.42.42.10(pid=11950): Terminated {rc=256} 20:30:18.788647 --- ParallelTerminationStrategy: PID 11951 died... 20:30:18.808344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11951): Terminated: ok {rc=0} 20:30:18.854546 --- ParallelTerminationStrategy: PID 11952 died... 20:30:18.874061 run iperf3-srv_10.42.42.10(pid=11952): Terminated {rc=256} 20:30:18.920414 --- ParallelTerminationStrategy: PID 11955 died... 20:30:18.940494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11955): Terminated: ok {rc=0} 20:30:18.987097 --- ParallelTerminationStrategy: PID 11958 died... 20:30:19.006807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11958): Terminated: ok {rc=0} 20:30:19.053237 --- ParallelTerminationStrategy: PID 11961 died... 20:30:19.073009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11961): Terminated: ok {rc=0} 20:30:19.161206 bus /gobi_0: Setting Powered False 20:30:20.259269 bus /gobi_0: Setting Powered False 20:30:21.373918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:30:22.524024 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:22.535914 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:22.610464 tst iperf3.py: using LAC 23532 20:30:22.740721 tst iperf3.py: using RAC 72 20:30:22.869753 tst iperf3.py: using CellId 23532 20:30:23.000668 tst iperf3.py: using BVCI 23533 20:30:23.121734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.132896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.144002 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.155491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.166605 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.177746 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.188930 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.200285 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:23.211566 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:23.329109 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:30:23.536232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:23.844668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Launched 20:30:24.112632 run iperf3-srv_10.42.42.10(pid=11964): Launched 20:30:24.227412 tst iperf3.py:8: start network... 20:30:24.433283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:24.908815 run create_hlr_db(pid=11965): Launched 20:30:25.027502 bus /gobi_6: Setting Powered False 20:30:26.088407 run create_hlr_db(pid=11965): Terminated: ok {rc=0} 20:30:26.538783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Launched 20:30:26.867119 run osmo-hlr_10.42.42.2(pid=11968): Launched 20:30:26.993930 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:27.564402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Launched 20:30:27.891579 run osmo-stp_10.42.42.5(pid=11971): Launched 20:30:28.019846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:28.588163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Launched 20:30:28.712934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:28.990427 run patchelf(pid=11974): Launched 20:30:29.161815 run osmo-stp_10.42.42.5(pid=11971): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] 20:30:29.291578 run osmo-stp_10.42.42.5(pid=11971): stdout: | (launched: 2022-12-09_20:30:27.831618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:29.423097 run osmo-stp_10.42.42.5(pid=11971): stderr: | 20221209203028023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203028023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203028024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203028024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203028025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203028025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203028025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:29.554825 run osmo-stp_10.42.42.5(pid=11971): stdout: | (launched: 2022-12-09_20:30:27.831618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:29.680825 run osmo-stp_10.42.42.5(pid=11971): stderr: | 20221209203028023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203028023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203028024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203028024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203028025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203028025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203028025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:29.829944 run patchelf(pid=11974): Terminating (SIGINT) 20:30:30.001816 run patchelf(pid=11974): Terminated: ok {rc=0} 20:30:30.126090 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11971): Process ended prematurely: osmo-stp_10.42.42.5(pid=11971) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 20:30:30.135790 tst iperf3.py:8: Test FAILED (7.7 sec) 20:30:30.163962 run osmo-hlr_10.42.42.2(pid=11968): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11968)] 20:30:30.212809 run osmo-hlr_10.42.42.2(pid=11968): stdout: | (launched: 2022-12-09_20:30:26.807315) 20:30:30.263321 run osmo-hlr_10.42.42.2(pid=11968): stderr: | 20221209203027008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203027008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203027008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203027008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203027008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203027008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203027022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203027030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203027030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203027030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:30.314079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Terminating (SIGTERM) 20:30:30.354641 run iperf3-srv_10.42.42.10(pid=11964): Terminating (SIGTERM) 20:30:30.394967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Terminating (SIGTERM) 20:30:30.435397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Terminating (SIGTERM) 20:30:30.475671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Terminating (SIGTERM) 20:30:30.516283 --- ParallelTerminationStrategy: PID 11963 died... 20:30:30.535536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11963): Terminated: ok {rc=0} 20:30:30.580444 --- ParallelTerminationStrategy: PID 11964 died... 20:30:30.599086 run iperf3-srv_10.42.42.10(pid=11964): Terminated {rc=256} 20:30:30.643673 --- ParallelTerminationStrategy: PID 11967 died... 20:30:30.662457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11967): Terminated: ok {rc=0} 20:30:30.707088 --- ParallelTerminationStrategy: PID 11970 died... 20:30:30.725931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11970): Terminated: ok {rc=0} 20:30:30.771020 --- ParallelTerminationStrategy: PID 11973 died... 20:30:30.789854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11973): Terminated: ok {rc=0} 20:30:30.888314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:30:32.062954 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.078161 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:32.166216 tst iperf3m4.py: using LAC 23533 20:30:32.295895 tst iperf3m4.py: using RAC 73 20:30:32.416418 tst iperf3m4.py: using CellId 23533 20:30:32.535701 tst iperf3m4.py: using BVCI 23534 20:30:32.647378 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.658346 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.669130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.680085 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.691135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.702152 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.713716 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.724661 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:32.735782 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:32.858581 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:32.979711 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:33.101197 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:33.220620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:30:33.428043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:33.736873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Launched 20:30:34.004364 run iperf3-srv_10.42.42.10(pid=11977): Launched 20:30:34.119134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:30:34.324509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:34.631794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11978): Launched 20:30:34.898940 run iperf3-srv_10.42.42.10(pid=11979): Launched 20:30:35.013996 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:30:35.219536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:35.526392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11980): Launched 20:30:35.795797 run iperf3-srv_10.42.42.10(pid=11981): Launched 20:30:35.912490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:30:36.117741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:30:36.425208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11982): Launched 20:30:36.691913 run iperf3-srv_10.42.42.10(pid=11983): Launched 20:30:36.806780 tst iperf3m4.py:8: start network... 20:30:37.012712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:37.487017 run create_hlr_db(pid=11984): Launched 20:30:37.605902 bus /gobi_6: Setting Powered False 20:30:38.666511 run create_hlr_db(pid=11984): Terminated: ok {rc=0} 20:30:39.093005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Launched 20:30:39.400681 run osmo-hlr_10.42.42.2(pid=11987): Launched 20:30:39.517969 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:40.059021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Launched 20:30:40.366813 run osmo-stp_10.42.42.5(pid=11990): Launched 20:30:40.485771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:41.014644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Launched 20:30:41.134241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:41.394975 run patchelf(pid=11993): Launched 20:30:41.567071 run osmo-stp_10.42.42.5(pid=11990): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] 20:30:41.696740 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-09_20:30:40.310489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:41.828039 run osmo-stp_10.42.42.5(pid=11990): stderr: | 20221209203040478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203040478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203040478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203040479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203040479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203040479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203040480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:41.959446 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-09_20:30:40.310489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:42.085417 run osmo-stp_10.42.42.5(pid=11990): stderr: | 20221209203040478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203040478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203040478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203040479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203040479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203040479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203040480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:42.234864 run patchelf(pid=11993): Terminating (SIGINT) 20:30:42.406112 run patchelf(pid=11993): Terminated: ok {rc=0} 20:30:42.529729 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:30:42.539280 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:30:42.567382 run osmo-hlr_10.42.42.2(pid=11987): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11987)] 20:30:42.615402 run osmo-hlr_10.42.42.2(pid=11987): stdout: | (launched: 2022-12-09_20:30:39.344109) 20:30:42.665354 run osmo-hlr_10.42.42.2(pid=11987): stderr: | 20221209203039517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203039517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203039517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203039517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203039517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203039517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203039529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203039537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203039538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203039538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:42.715547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Terminating (SIGTERM) 20:30:42.755673 run iperf3-srv_10.42.42.10(pid=11977): Terminating (SIGTERM) 20:30:42.795933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11978): Terminating (SIGTERM) 20:30:42.836222 run iperf3-srv_10.42.42.10(pid=11979): Terminating (SIGTERM) 20:30:42.876089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11980): Terminating (SIGTERM) 20:30:42.916042 run iperf3-srv_10.42.42.10(pid=11981): Terminating (SIGTERM) 20:30:42.956002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11982): Terminating (SIGTERM) 20:30:42.996530 run iperf3-srv_10.42.42.10(pid=11983): Terminating (SIGTERM) 20:30:43.036476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminating (SIGTERM) 20:30:43.076496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminating (SIGTERM) 20:30:43.116781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Terminating (SIGTERM) 20:30:43.157527 --- ParallelTerminationStrategy: PID 11976 died... 20:30:43.176820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11976): Terminated: ok {rc=0} 20:30:43.222062 --- ParallelTerminationStrategy: PID 11977 died... 20:30:43.240941 run iperf3-srv_10.42.42.10(pid=11977): Terminated {rc=256} 20:30:43.285243 --- ParallelTerminationStrategy: PID 11978 died... 20:30:43.304027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11978): Terminated: ok {rc=0} 20:30:43.348611 --- ParallelTerminationStrategy: PID 11979 died... 20:30:43.367579 run iperf3-srv_10.42.42.10(pid=11979): Terminated {rc=256} 20:30:43.411918 --- ParallelTerminationStrategy: PID 11980 died... 20:30:43.430652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11980): Terminated: ok {rc=0} 20:30:43.475801 --- ParallelTerminationStrategy: PID 11981 died... 20:30:43.494713 run iperf3-srv_10.42.42.10(pid=11981): Terminated {rc=256} 20:30:43.539069 --- ParallelTerminationStrategy: PID 11982 died... 20:30:43.557914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11982): Terminated: ok {rc=0} 20:30:43.602851 --- ParallelTerminationStrategy: PID 11983 died... 20:30:43.621778 run iperf3-srv_10.42.42.10(pid=11983): Terminated {rc=256} 20:30:43.665721 --- ParallelTerminationStrategy: PID 11986 died... 20:30:43.684403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminated: ok {rc=0} 20:30:43.729407 --- ParallelTerminationStrategy: PID 11989 died... 20:30:43.748339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminated: ok {rc=0} 20:30:43.793480 --- ParallelTerminationStrategy: PID 11992 died... 20:30:43.812318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Terminated: ok {rc=0} 20:30:43.899968 bus /gobi_4: Setting Powered False 20:30:45.000551 bus /gobi_4: Setting Powered False 20:30:46.124861 bus /gobi_1: Setting Powered False 20:30:47.234823 bus /gobi_1: Setting Powered False 20:30:48.354597 bus /gobi_0: Setting Powered False 20:30:49.453432 bus /gobi_0: Setting Powered False 20:30:50.570911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:30:51.674820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:51.686836 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:30:51.759995 tst ping.py: using LAC 23534 20:30:51.894897 tst ping.py: using RAC 74 20:30:52.023076 tst ping.py: using CellId 23534 20:30:52.150551 tst ping.py: using BVCI 23535 20:30:52.268088 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.279510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.290718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.301995 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.313043 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.324157 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.335572 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:52.346760 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:30:52.466337 tst ping.py:19: start network... 20:30:52.683594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:30:53.183837 run create_hlr_db(pid=11994): Launched 20:30:53.315256 bus /gobi_6: Setting Powered False 20:30:54.378784 run create_hlr_db(pid=11994): Terminated: ok {rc=0} 20:30:54.811249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Launched 20:30:55.113734 run osmo-hlr_10.42.42.2(pid=11997): Launched 20:30:55.228739 run osmo-stp_10.42.42.5: Starting osmo-stp 20:30:55.772149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Launched 20:30:56.074445 run osmo-stp_10.42.42.5(pid=12000): Launched 20:30:56.188425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:30:56.709119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Launched 20:30:56.833292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:30:57.107345 run patchelf(pid=12003): Launched 20:30:57.286887 run osmo-stp_10.42.42.5(pid=12000): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] 20:30:57.423459 run osmo-stp_10.42.42.5(pid=12000): stdout: | (launched: 2022-12-09_20:30:56.018574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:57.561881 run osmo-stp_10.42.42.5(pid=12000): stderr: | 20221209203056191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203056191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203056192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203056192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203056193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203056193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203056193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:57.700220 run osmo-stp_10.42.42.5(pid=12000): stdout: | (launched: 2022-12-09_20:30:56.018574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:30:57.832047 run osmo-stp_10.42.42.5(pid=12000): stderr: | 20221209203056191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203056191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203056192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203056192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203056193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203056193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203056193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:30:57.988454 run patchelf(pid=12003): Terminating (SIGINT) 20:30:58.169150 run patchelf(pid=12003): Terminated: ok {rc=0} 20:30:58.298606 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12000): Process ended prematurely: osmo-stp_10.42.42.5(pid=12000) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 20:30:58.308145 tst ping.py:22: Test FAILED (6.6 sec) 20:30:58.336418 run osmo-hlr_10.42.42.2(pid=11997): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11997)] 20:30:58.386338 run osmo-hlr_10.42.42.2(pid=11997): stdout: | (launched: 2022-12-09_20:30:55.057952) 20:30:58.438022 run osmo-hlr_10.42.42.2(pid=11997): stderr: | 20221209203055235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203055235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203055235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203055235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203055235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203055236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203055247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203055256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203055257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203055257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:30:58.489854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Terminating (SIGTERM) 20:30:58.531399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Terminating (SIGTERM) 20:30:58.572864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Terminating (SIGTERM) 20:30:58.615022 --- ParallelTerminationStrategy: PID 11996 died... 20:30:58.634979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Terminated: ok {rc=0} 20:30:58.681026 --- ParallelTerminationStrategy: PID 11999 died... 20:30:58.700575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Terminated: ok {rc=0} 20:30:58.746640 --- ParallelTerminationStrategy: PID 12002 died... 20:30:58.766122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Terminated: ok {rc=0} 20:30:58.853297 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:30:59.941908 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:30:59.954344 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:31:00.030460 tst ping_idle_ping.py: using LAC 23535 20:31:00.157397 tst ping_idle_ping.py: using RAC 75 20:31:00.282289 tst ping_idle_ping.py: using CellId 23535 20:31:00.407397 tst ping_idle_ping.py: using BVCI 23536 20:31:00.526340 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.537669 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.548616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.559871 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.570902 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.582032 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.593219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:31:00.604303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:31:00.722067 tst ping_idle_ping.py:24: start network... 20:31:00.944572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:01.424044 run create_hlr_db(pid=12004): Launched 20:31:01.550768 bus /gobi_6: Setting Powered False 20:31:02.610862 run create_hlr_db(pid=12004): Terminated: ok {rc=0} 20:31:03.032493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12006): Launched 20:31:03.336141 run osmo-hlr_10.42.42.2(pid=12007): Launched 20:31:03.451573 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:03.970267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12009): Launched 20:31:04.271792 run osmo-stp_10.42.42.5(pid=12010): Launched 20:31:04.387423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:04.909099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12012): Launched 20:31:05.024396 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:05.279304 run patchelf(pid=12013): Launched 20:31:05.447108 run osmo-stp_10.42.42.5(pid=12010): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12010)] 20:31:05.575689 run osmo-stp_10.42.42.5(pid=12010): stdout: | (launched: 2022-12-09_20:31:04.216203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:05.705192 run osmo-stp_10.42.42.5(pid=12010): stderr: | 20221209203104387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203104387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203104387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203104388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203104388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203104388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203104388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:05.834785 run osmo-stp_10.42.42.5(pid=12010): stdout: | (launched: 2022-12-09_20:31:04.216203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:05.958616 run osmo-stp_10.42.42.5(pid=12010): stderr: | 20221209203104387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203104387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203104387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203104388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203104388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203104388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203104388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:06.104939 run patchelf(pid=12013): Terminating (SIGINT) 20:31:06.274081 run patchelf(pid=12013): Terminated: ok {rc=0} 20:31:06.395988 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12010): Process ended prematurely: osmo-stp_10.42.42.5(pid=12010) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12010)] [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:31:06.405080 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:31:06.432311 run osmo-hlr_10.42.42.2(pid=12007): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12007)] 20:31:06.480209 run osmo-hlr_10.42.42.2(pid=12007): stdout: | (launched: 2022-12-09_20:31:03.279654) 20:31:06.529465 run osmo-hlr_10.42.42.2(pid=12007): stderr: | 20221209203103456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203103456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203103456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203103456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203103456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203103456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203103516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203103525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203103525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203103525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:06.579102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12006): Terminating (SIGTERM) 20:31:06.618500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12009): Terminating (SIGTERM) 20:31:06.657741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12012): Terminating (SIGTERM) 20:31:06.697244 --- ParallelTerminationStrategy: PID 12006 died... 20:31:06.715840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12006): Terminated: ok {rc=0} 20:31:06.759726 --- ParallelTerminationStrategy: PID 12009 died... 20:31:06.778133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12009): Terminated: ok {rc=0} 20:31:06.822156 --- ParallelTerminationStrategy: PID 12012 died... 20:31:06.840614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12012): Terminated: ok {rc=0} 20:31:06.924072 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:31:08.233552 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:31:08.240388 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:31:08.273922 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 20:31:08.313352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 20:31:08.402319 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:31:08.436303 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 20:31:08.475137 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 20:31:09.071969 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 20:31:09.123360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.134741 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:09.187604 tst cs_paging_gprs_active.py: using LAC 23536 20:31:09.313435 tst cs_paging_gprs_active.py: using RAC 76 20:31:09.435164 tst cs_paging_gprs_active.py: using CellId 23536 20:31:09.556269 tst cs_paging_gprs_active.py: using BVCI 23537 20:31:09.668531 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.680194 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.691267 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.702686 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.714164 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.725622 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.737085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.748368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:09.759767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:09.877567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:09.995376 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:31:10.203872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:10.514359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12017): Launched 20:31:10.784289 run iperf3-srv_10.42.42.10(pid=12018): Launched 20:31:10.899775 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:31:11.106328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:11.415502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12019): Launched 20:31:11.682980 run iperf3-srv_10.42.42.10(pid=12020): Launched 20:31:11.798931 tst cs_paging_gprs_active.py:38: start network... 20:31:12.005852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:12.483672 run create_hlr_db(pid=12021): Launched 20:31:12.601343 bus /gobi_6: Setting Powered False 20:31:13.661752 run create_hlr_db(pid=12021): Terminated: ok {rc=0} 20:31:14.112320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12023): Launched 20:31:14.441905 run osmo-hlr_10.42.42.2(pid=12024): Launched 20:31:14.571628 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:15.139262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12026): Launched 20:31:15.470590 run osmo-stp_10.42.42.5(pid=12027): Launched 20:31:15.598086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:16.198611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12029): Launched 20:31:16.376018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:16.704466 run patchelf(pid=12030): Launched 20:31:16.907676 run osmo-stp_10.42.42.5(pid=12027): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12027)] 20:31:17.050826 run osmo-stp_10.42.42.5(pid=12027): stdout: | (launched: 2022-12-09_20:31:15.410383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:17.195346 run osmo-stp_10.42.42.5(pid=12027): stderr: | 20221209203115601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203115601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203115602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203115602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203115602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203115603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203115603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:17.337154 run osmo-stp_10.42.42.5(pid=12027): stdout: | (launched: 2022-12-09_20:31:15.410383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:17.472358 run osmo-stp_10.42.42.5(pid=12027): stderr: | 20221209203115601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203115601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203115602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203115602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203115602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203115603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203115603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:17.632654 run patchelf(pid=12030): Terminating (SIGINT) 20:31:17.816757 run patchelf(pid=12030): Terminated: ok {rc=0} 20:31:17.949360 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12027): Process ended prematurely: osmo-stp_10.42.42.5(pid=12027) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12027)] [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 20:31:17.959687 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:31:17.988605 run osmo-hlr_10.42.42.2(pid=12024): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12024)] 20:31:18.039500 run osmo-hlr_10.42.42.2(pid=12024): stdout: | (launched: 2022-12-09_20:31:14.381830) 20:31:18.091907 run osmo-hlr_10.42.42.2(pid=12024): stderr: | 20221209203114581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203114581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203114581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203114581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203114581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203114581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203114594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203114605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203114605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203114605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:18.144583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12017): Terminating (SIGTERM) 20:31:18.186527 run iperf3-srv_10.42.42.10(pid=12018): Terminating (SIGTERM) 20:31:18.228595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12019): Terminating (SIGTERM) 20:31:18.270550 run iperf3-srv_10.42.42.10(pid=12020): Terminating (SIGTERM) 20:31:18.312546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12023): Terminating (SIGTERM) 20:31:18.355208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12026): Terminating (SIGTERM) 20:31:18.397526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12029): Terminating (SIGTERM) 20:31:18.439797 --- ParallelTerminationStrategy: PID 12017 died... 20:31:18.459344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12017): Terminated: ok {rc=0} 20:31:18.505552 --- ParallelTerminationStrategy: PID 12018 died... 20:31:18.524871 run iperf3-srv_10.42.42.10(pid=12018): Terminated {rc=256} 20:31:18.571067 --- ParallelTerminationStrategy: PID 12019 died... 20:31:18.590600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12019): Terminated: ok {rc=0} 20:31:18.636368 --- ParallelTerminationStrategy: PID 12020 died... 20:31:18.655817 run iperf3-srv_10.42.42.10(pid=12020): Terminated {rc=256} 20:31:18.701651 --- ParallelTerminationStrategy: PID 12023 died... 20:31:18.721258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12023): Terminated: ok {rc=0} 20:31:18.767215 --- ParallelTerminationStrategy: PID 12026 died... 20:31:18.786939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12026): Terminated: ok {rc=0} 20:31:18.833422 --- ParallelTerminationStrategy: PID 12029 died... 20:31:18.853204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12029): Terminated: ok {rc=0} 20:31:18.941580 bus /gobi_0: Setting Powered False 20:31:20.040038 bus /gobi_0: Setting Powered False 20:31:21.157087 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 20:31:22.305133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.317259 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:22.372502 tst iperf3.py: using LAC 23537 20:31:22.494700 tst iperf3.py: using RAC 77 20:31:22.616926 tst iperf3.py: using CellId 23537 20:31:22.737046 tst iperf3.py: using BVCI 23538 20:31:22.848719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.860056 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.871141 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.882449 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.893696 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.905598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.917187 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.928524 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:22.939910 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:23.060651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:31:23.283828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:23.615067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12031): Launched 20:31:23.902504 run iperf3-srv_10.42.42.10(pid=12032): Launched 20:31:24.027617 tst iperf3.py:8: start network... 20:31:24.249936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:24.760098 run create_hlr_db(pid=12033): Launched 20:31:24.893514 bus /gobi_6: Setting Powered False 20:31:25.958517 run create_hlr_db(pid=12033): Terminated: ok {rc=0} 20:31:26.397534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12035): Launched 20:31:26.705803 run osmo-hlr_10.42.42.2(pid=12036): Launched 20:31:26.825429 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:27.367381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12038): Launched 20:31:27.675325 run osmo-stp_10.42.42.5(pid=12039): Launched 20:31:27.794516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:28.324457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12041): Launched 20:31:28.451157 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:28.729930 run patchelf(pid=12042): Launched 20:31:28.912727 run osmo-stp_10.42.42.5(pid=12039): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12039)] 20:31:29.051701 run osmo-stp_10.42.42.5(pid=12039): stdout: | (launched: 2022-12-09_20:31:27.618631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:29.192029 run osmo-stp_10.42.42.5(pid=12039): stderr: | 20221209203127792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203127792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203127792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203127792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203127793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203127793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203127793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:29.331843 run osmo-stp_10.42.42.5(pid=12039): stdout: | (launched: 2022-12-09_20:31:27.618631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:29.466242 run osmo-stp_10.42.42.5(pid=12039): stderr: | 20221209203127792 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203127792 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203127792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203127792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203127793 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203127793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203127793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:29.626138 run patchelf(pid=12042): Terminating (SIGINT) 20:31:29.809403 run patchelf(pid=12042): Terminated: ok {rc=0} 20:31:29.941964 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12039): Process ended prematurely: osmo-stp_10.42.42.5(pid=12039) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12039)] [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 20:31:29.952212 tst iperf3.py:8: Test FAILED (7.7 sec) 20:31:29.980692 run osmo-hlr_10.42.42.2(pid=12036): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12036)] 20:31:30.030642 run osmo-hlr_10.42.42.2(pid=12036): stdout: | (launched: 2022-12-09_20:31:26.649311) 20:31:30.082111 run osmo-hlr_10.42.42.2(pid=12036): stderr: | 20221209203126828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203126828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203126828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203126828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203126828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203126828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203126841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203126849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203126850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203126850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:30.133859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12031): Terminating (SIGTERM) 20:31:30.175219 run iperf3-srv_10.42.42.10(pid=12032): Terminating (SIGTERM) 20:31:30.216508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12035): Terminating (SIGTERM) 20:31:30.258034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12038): Terminating (SIGTERM) 20:31:30.299475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12041): Terminating (SIGTERM) 20:31:30.341070 --- ParallelTerminationStrategy: PID 12031 died... 20:31:30.360817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12031): Terminated: ok {rc=0} 20:31:30.406625 --- ParallelTerminationStrategy: PID 12032 died... 20:31:30.425919 run iperf3-srv_10.42.42.10(pid=12032): Terminated {rc=256} 20:31:30.471458 --- ParallelTerminationStrategy: PID 12035 died... 20:31:30.490832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12035): Terminated: ok {rc=0} 20:31:30.536394 --- ParallelTerminationStrategy: PID 12038 died... 20:31:30.555819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12038): Terminated: ok {rc=0} 20:31:30.601250 --- ParallelTerminationStrategy: PID 12041 died... 20:31:30.620472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12041): Terminated: ok {rc=0} 20:31:30.707337 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 20:31:31.877084 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:31.890105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:31.948503 tst iperf3m4.py: using LAC 23538 20:31:32.071966 tst iperf3m4.py: using RAC 78 20:31:32.223337 tst iperf3m4.py: using CellId 23538 20:31:32.352609 tst iperf3m4.py: using BVCI 23539 20:31:32.471887 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.483698 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.495293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.506858 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.518569 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.530165 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.541858 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.553343 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:32.565109 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:32.685526 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:32.809356 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:32.931628 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:33.053602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:31:33.276699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:33.608046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12043): Launched 20:31:33.894593 run iperf3-srv_10.42.42.10(pid=12044): Launched 20:31:34.019694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:31:34.242585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:34.573222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12045): Launched 20:31:34.859233 run iperf3-srv_10.42.42.10(pid=12046): Launched 20:31:34.984497 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:31:35.207747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:35.538748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12047): Launched 20:31:35.824825 run iperf3-srv_10.42.42.10(pid=12048): Launched 20:31:35.947245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:31:36.168906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:31:36.498447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12049): Launched 20:31:36.785550 run iperf3-srv_10.42.42.10(pid=12050): Launched 20:31:36.907991 tst iperf3m4.py:8: start network... 20:31:37.130630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:37.642130 run create_hlr_db(pid=12051): Launched 20:31:37.776343 bus /gobi_6: Setting Powered False 20:31:38.841566 run create_hlr_db(pid=12051): Terminated: ok {rc=0} 20:31:39.279577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12053): Launched 20:31:39.588340 run osmo-hlr_10.42.42.2(pid=12054): Launched 20:31:39.707222 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:40.256078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12056): Launched 20:31:40.564185 run osmo-stp_10.42.42.5(pid=12057): Launched 20:31:40.682753 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:41.212737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12059): Launched 20:31:41.330042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:41.589616 run patchelf(pid=12060): Launched 20:31:41.760214 run osmo-stp_10.42.42.5(pid=12057): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12057)] 20:31:41.890101 run osmo-stp_10.42.42.5(pid=12057): stdout: | (launched: 2022-12-09_20:31:40.507137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:42.021331 run osmo-stp_10.42.42.5(pid=12057): stderr: | 20221209203140675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203140675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203140675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203140675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203140676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203140676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203140676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:42.153160 run osmo-stp_10.42.42.5(pid=12057): stdout: | (launched: 2022-12-09_20:31:40.507137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:42.278858 run osmo-stp_10.42.42.5(pid=12057): stderr: | 20221209203140675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203140675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203140675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203140675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203140676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203140676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203140676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:42.428301 run patchelf(pid=12060): Terminating (SIGINT) 20:31:42.600590 run patchelf(pid=12060): Terminated: ok {rc=0} 20:31:42.725261 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12057): Process ended prematurely: osmo-stp_10.42.42.5(pid=12057) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12057)] [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 20:31:42.734965 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:31:42.762735 run osmo-hlr_10.42.42.2(pid=12054): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12054)] 20:31:42.810668 run osmo-hlr_10.42.42.2(pid=12054): stdout: | (launched: 2022-12-09_20:31:39.531206) 20:31:42.859726 run osmo-hlr_10.42.42.2(pid=12054): stderr: | 20221209203139703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203139703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203139704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203139704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203139704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203139704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203139716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203139724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203139725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203139725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:42.909423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12043): Terminating (SIGTERM) 20:31:42.948647 run iperf3-srv_10.42.42.10(pid=12044): Terminating (SIGTERM) 20:31:42.987865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12045): Terminating (SIGTERM) 20:31:43.027206 run iperf3-srv_10.42.42.10(pid=12046): Terminating (SIGTERM) 20:31:43.066432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12047): Terminating (SIGTERM) 20:31:43.105742 run iperf3-srv_10.42.42.10(pid=12048): Terminating (SIGTERM) 20:31:43.144891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12049): Terminating (SIGTERM) 20:31:43.184021 run iperf3-srv_10.42.42.10(pid=12050): Terminating (SIGTERM) 20:31:43.223411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12053): Terminating (SIGTERM) 20:31:43.262552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12056): Terminating (SIGTERM) 20:31:43.301757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12059): Terminating (SIGTERM) 20:31:43.341288 --- ParallelTerminationStrategy: PID 12043 died... 20:31:43.360063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12043): Terminated: ok {rc=0} 20:31:43.404064 --- ParallelTerminationStrategy: PID 12044 died... 20:31:43.422585 run iperf3-srv_10.42.42.10(pid=12044): Terminated {rc=256} 20:31:43.466487 --- ParallelTerminationStrategy: PID 12045 died... 20:31:43.484874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12045): Terminated: ok {rc=0} 20:31:43.529014 --- ParallelTerminationStrategy: PID 12046 died... 20:31:43.547415 run iperf3-srv_10.42.42.10(pid=12046): Terminated {rc=256} 20:31:43.591304 --- ParallelTerminationStrategy: PID 12047 died... 20:31:43.610394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12047): Terminated: ok {rc=0} 20:31:43.655135 --- ParallelTerminationStrategy: PID 12048 died... 20:31:43.673625 run iperf3-srv_10.42.42.10(pid=12048): Terminated {rc=256} 20:31:43.717415 --- ParallelTerminationStrategy: PID 12049 died... 20:31:43.735686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12049): Terminated: ok {rc=0} 20:31:43.779596 --- ParallelTerminationStrategy: PID 12050 died... 20:31:43.797929 run iperf3-srv_10.42.42.10(pid=12050): Terminated {rc=256} 20:31:43.841690 --- ParallelTerminationStrategy: PID 12053 died... 20:31:43.860241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12053): Terminated: ok {rc=0} 20:31:43.904274 --- ParallelTerminationStrategy: PID 12056 died... 20:31:43.922739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12056): Terminated: ok {rc=0} 20:31:43.966653 --- ParallelTerminationStrategy: PID 12059 died... 20:31:43.985187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12059): Terminated: ok {rc=0} 20:31:44.071694 bus /gobi_4: Setting Powered False 20:31:45.172364 bus /gobi_4: Setting Powered False 20:31:46.300080 bus /gobi_1: Setting Powered False 20:31:47.412068 bus /gobi_1: Setting Powered False 20:31:48.529140 bus /gobi_0: Setting Powered False 20:31:49.627324 bus /gobi_0: Setting Powered False 20:31:50.745505 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 20:31:51.849223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:51.861839 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:51.916023 tst ping.py: using LAC 23539 20:31:52.036738 tst ping.py: using RAC 79 20:31:52.154613 tst ping.py: using CellId 23539 20:31:52.277114 tst ping.py: using BVCI 23540 20:31:52.387820 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.399131 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.410333 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.421653 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.432781 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.444188 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.455590 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:52.466738 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:31:52.585902 tst ping.py:19: start network... 20:31:52.786835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:31:53.253175 run create_hlr_db(pid=12061): Launched 20:31:53.368499 bus /gobi_6: Setting Powered False 20:31:54.428798 run create_hlr_db(pid=12061): Terminated: ok {rc=0} 20:31:54.849935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12063): Launched 20:31:55.153638 run osmo-hlr_10.42.42.2(pid=12064): Launched 20:31:55.269502 run osmo-stp_10.42.42.5: Starting osmo-stp 20:31:55.808177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12066): Launched 20:31:56.109956 run osmo-stp_10.42.42.5(pid=12067): Launched 20:31:56.225478 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:31:56.746839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12069): Launched 20:31:56.863183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:31:57.118485 run patchelf(pid=12070): Launched 20:31:57.285507 run osmo-stp_10.42.42.5(pid=12067): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12067)] 20:31:57.412710 run osmo-stp_10.42.42.5(pid=12067): stdout: | (launched: 2022-12-09_20:31:56.054325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:57.542040 run osmo-stp_10.42.42.5(pid=12067): stderr: | 20221209203156224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203156224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203156224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203156225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203156225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203156226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203156226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:57.671008 run osmo-stp_10.42.42.5(pid=12067): stdout: | (launched: 2022-12-09_20:31:56.054325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:31:57.794723 run osmo-stp_10.42.42.5(pid=12067): stderr: | 20221209203156224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203156224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203156224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203156225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203156225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203156226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203156226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:31:57.941237 run patchelf(pid=12070): Terminating (SIGINT) 20:31:58.110426 run patchelf(pid=12070): Terminated: ok {rc=0} 20:31:58.232374 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12067): Process ended prematurely: osmo-stp_10.42.42.5(pid=12067) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12067)] [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 20:31:58.241659 tst ping.py:22: Test FAILED (6.4 sec) 20:31:58.269096 run osmo-hlr_10.42.42.2(pid=12064): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12064)] 20:31:58.316695 run osmo-hlr_10.42.42.2(pid=12064): stdout: | (launched: 2022-12-09_20:31:55.097793) 20:31:58.366151 run osmo-hlr_10.42.42.2(pid=12064): stderr: | 20221209203155276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203155276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203155276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203155276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203155276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203155276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203155288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203155296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203155296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203155296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:31:58.415960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12063): Terminating (SIGTERM) 20:31:58.455294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12066): Terminating (SIGTERM) 20:31:58.494687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12069): Terminating (SIGTERM) 20:31:58.534592 --- ParallelTerminationStrategy: PID 12063 died... 20:31:58.553595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12063): Terminated: ok {rc=0} 20:31:58.597732 --- ParallelTerminationStrategy: PID 12066 died... 20:31:58.616145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12066): Terminated: ok {rc=0} 20:31:58.660583 --- ParallelTerminationStrategy: PID 12069 died... 20:31:58.679330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12069): Terminated: ok {rc=0} 20:31:58.763688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 20:31:59.848168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:31:59.860229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:31:59.919766 tst ping_idle_ping.py: using LAC 23540 20:32:00.039793 tst ping_idle_ping.py: using RAC 80 20:32:00.169409 tst ping_idle_ping.py: using CellId 23540 20:32:00.297604 tst ping_idle_ping.py: using BVCI 23541 20:32:00.416102 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.428298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.440173 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.452399 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.464581 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.477454 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.489838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:32:00.501524 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:32:00.620334 tst ping_idle_ping.py:24: start network... 20:32:00.823957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:01.365736 run create_hlr_db(pid=12071): Launched 20:32:01.530495 bus /gobi_6: Setting Powered False 20:32:02.595006 run create_hlr_db(pid=12071): Terminated: ok {rc=0} 20:32:03.031918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12073): Launched 20:32:03.335153 run osmo-hlr_10.42.42.2(pid=12074): Launched 20:32:03.450563 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:03.988858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12076): Launched 20:32:04.292118 run osmo-stp_10.42.42.5(pid=12077): Launched 20:32:04.408468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:32:04.931499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12079): Launched 20:32:05.047902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:32:05.304255 run patchelf(pid=12080): Launched 20:32:05.472551 run osmo-stp_10.42.42.5(pid=12077): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12077)] 20:32:05.600874 run osmo-stp_10.42.42.5(pid=12077): stdout: | (launched: 2022-12-09_20:32:04.236263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:05.730851 run osmo-stp_10.42.42.5(pid=12077): stderr: | 20221209203204408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203204408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203204409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203204409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203204410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203204410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203204410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:05.861479 run osmo-stp_10.42.42.5(pid=12077): stdout: | (launched: 2022-12-09_20:32:04.236263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:05.985638 run osmo-stp_10.42.42.5(pid=12077): stderr: | 20221209203204408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203204408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203204409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203204409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203204410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203204410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203204410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:06.132901 run patchelf(pid=12080): Terminating (SIGINT) 20:32:06.302520 run patchelf(pid=12080): Terminated: ok {rc=0} 20:32:06.424873 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12077): Process ended prematurely: osmo-stp_10.42.42.5(pid=12077) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12077)] [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 20:32:06.434132 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:32:06.461273 run osmo-hlr_10.42.42.2(pid=12074): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12074)] 20:32:06.510253 run osmo-hlr_10.42.42.2(pid=12074): stdout: | (launched: 2022-12-09_20:32:03.279355) 20:32:06.559937 run osmo-hlr_10.42.42.2(pid=12074): stderr: | 20221209203203454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203203454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203203454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203203455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203203455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203203455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203203467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203203476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203203476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203203476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:06.609935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12073): Terminating (SIGTERM) 20:32:06.649860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12076): Terminating (SIGTERM) 20:32:06.689674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12079): Terminating (SIGTERM) 20:32:06.729898 --- ParallelTerminationStrategy: PID 12073 died... 20:32:06.748930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12073): Terminated: ok {rc=0} 20:32:06.793526 --- ParallelTerminationStrategy: PID 12076 died... 20:32:06.812042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12076): Terminated: ok {rc=0} 20:32:06.857105 --- ParallelTerminationStrategy: PID 12079 died... 20:32:06.875681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12079): Terminated: ok {rc=0} 20:32:06.962642 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:32:08.273635 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:08.280403 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:32:08.314243 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:32:08.348507 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:32:08.399238 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:32:08.432303 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:32:08.466448 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:32:09.026169 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:32:09.031197 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.042542 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:32:09.110252 tst switch_tch_pdch.py: using LAC 23541 20:32:09.226739 tst switch_tch_pdch.py: using RAC 81 20:32:09.343176 tst switch_tch_pdch.py: using CellId 23541 20:32:09.459938 tst switch_tch_pdch.py: using BVCI 23542 20:32:09.569466 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.580562 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.591516 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.603163 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.614340 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.625551 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.636834 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:32:09.648022 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:32:09.768155 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:32:09.890520 tst switch_tch_pdch.py:51: start network... 20:32:10.109681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:10.611248 run create_hlr_db(pid=12087): Launched 20:32:10.743720 bus /gobi_6: Setting Powered False 20:32:11.807044 run create_hlr_db(pid=12087): Terminated: ok {rc=0} 20:32:12.240126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Launched 20:32:12.542537 run osmo-hlr_10.42.42.2(pid=12090): Launched 20:32:12.659393 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:13.183116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Launched 20:32:13.484379 run osmo-stp_10.42.42.5(pid=12093): Launched 20:32:13.599609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:32:14.120794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Launched 20:32:14.241295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:32:14.504745 run patchelf(pid=12099): Launched 20:32:14.671921 run osmo-stp_10.42.42.5(pid=12093): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] 20:32:14.799309 run osmo-stp_10.42.42.5(pid=12093): stdout: | (launched: 2022-12-09_20:32:13.428566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:14.928472 run osmo-stp_10.42.42.5(pid=12093): stderr: | 20221209203213599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203213600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203213600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203213600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203213601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203213601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203213601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:15.057700 run osmo-stp_10.42.42.5(pid=12093): stdout: | (launched: 2022-12-09_20:32:13.428566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:15.181373 run osmo-stp_10.42.42.5(pid=12093): stderr: | 20221209203213599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203213600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203213600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203213600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203213601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203213601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203213601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:15.327443 run patchelf(pid=12099): Terminating (SIGINT) 20:32:15.495478 run patchelf(pid=12099): Terminated: ok {rc=0} 20:32:15.616743 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12093): Process ended prematurely: osmo-stp_10.42.42.5(pid=12093) [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:32:15.625919 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:32:15.653535 run osmo-hlr_10.42.42.2(pid=12090): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12090)] 20:32:15.701328 run osmo-hlr_10.42.42.2(pid=12090): stdout: | (launched: 2022-12-09_20:32:12.486724) 20:32:15.750556 run osmo-hlr_10.42.42.2(pid=12090): stderr: | 20221209203212664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203212664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203212664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203212664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203212664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203212664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203212677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203212685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203212686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203212686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:15.800217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Terminating (SIGTERM) 20:32:15.857906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Terminating (SIGTERM) 20:32:15.910214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Terminating (SIGTERM) 20:32:15.954547 --- ParallelTerminationStrategy: PID 12089 died... 20:32:15.973950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12089): Terminated: ok {rc=0} 20:32:16.019260 --- ParallelTerminationStrategy: PID 12092 died... 20:32:16.038615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12092): Terminated: ok {rc=0} 20:32:16.084213 --- ParallelTerminationStrategy: PID 12095 died... 20:32:16.103616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12095): Terminated: ok {rc=0} 20:32:16.190175 bus /gobi_0: Setting Powered False 20:32:17.286072 bus /gobi_0: Setting Powered False 20:32:18.400475 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:32:19.658757 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:19.664811 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:32:19.698780 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:32:19.734114 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:32:19.787571 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:32:19.821671 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:32:19.857053 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:32:20.413717 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:32:20.418865 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:20.430230 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:32:20.504621 tst switch_tch_pdch.py: using LAC 23542 20:32:20.630741 tst switch_tch_pdch.py: using RAC 82 20:32:20.757432 tst switch_tch_pdch.py: using CellId 23542 20:32:20.884723 tst switch_tch_pdch.py: using BVCI 23543 20:32:21.001788 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.013226 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.024311 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.035785 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.047344 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.058585 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.069898 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:32:21.081042 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:32:21.197063 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:32:21.317308 tst switch_tch_pdch.py:51: start network... 20:32:21.534299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:22.006087 run create_hlr_db(pid=12103): Launched 20:32:22.139418 bus /gobi_6: Setting Powered False 20:32:23.202793 run create_hlr_db(pid=12103): Terminated: ok {rc=0} 20:32:23.608869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12105): Launched 20:32:23.932503 run osmo-hlr_10.42.42.2(pid=12106): Launched 20:32:24.055536 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:24.581308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12108): Launched 20:32:24.903131 run osmo-stp_10.42.42.5(pid=12109): Launched 20:32:25.026857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:32:25.553980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12111): Launched 20:32:25.677944 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:32:25.950517 run patchelf(pid=12112): Launched 20:32:26.131143 run osmo-stp_10.42.42.5(pid=12109): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12109)] 20:32:26.267724 run osmo-stp_10.42.42.5(pid=12109): stdout: | (launched: 2022-12-09_20:32:24.844143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:26.405939 run osmo-stp_10.42.42.5(pid=12109): stderr: | 20221209203225038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203225038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203225038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203225039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203225039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203225039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203225039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:26.543411 run osmo-stp_10.42.42.5(pid=12109): stdout: | (launched: 2022-12-09_20:32:24.844143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:26.675431 run osmo-stp_10.42.42.5(pid=12109): stderr: | 20221209203225038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203225038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203225038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203225039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203225039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203225039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203225039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:26.831606 run patchelf(pid=12112): Terminating (SIGINT) 20:32:27.011390 run patchelf(pid=12112): Terminated: ok {rc=0} 20:32:27.141326 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12109): Process ended prematurely: osmo-stp_10.42.42.5(pid=12109) [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12109)] [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:32:27.151013 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:32:27.178982 run osmo-hlr_10.42.42.2(pid=12106): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12106)] 20:32:27.229183 run osmo-hlr_10.42.42.2(pid=12106): stdout: | (launched: 2022-12-09_20:32:23.873109) 20:32:27.281128 run osmo-hlr_10.42.42.2(pid=12106): stderr: | 20221209203224075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203224075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203224075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203224075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203224075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203224075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203224090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203224099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203224100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203224100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:27.333368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12105): Terminating (SIGTERM) 20:32:27.375053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12108): Terminating (SIGTERM) 20:32:27.416612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12111): Terminating (SIGTERM) 20:32:27.458552 --- ParallelTerminationStrategy: PID 12105 died... 20:32:27.478483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12105): Terminated: ok {rc=0} 20:32:27.524277 --- ParallelTerminationStrategy: PID 12108 died... 20:32:27.543917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12108): Terminated: ok {rc=0} 20:32:27.589886 --- ParallelTerminationStrategy: PID 12111 died... 20:32:27.609448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12111): Terminated: ok {rc=0} 20:32:27.697570 bus /gobi_0: Setting Powered False 20:32:28.797578 bus /gobi_0: Setting Powered False 20:32:29.915411 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:31.205081 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:31.209639 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:31.253338 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 20:32:31.262756 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:32:31.319266 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:31.363228 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 20:32:31.373602 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:32:31.916560 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 20:32:31.923125 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 20:32:31.938259 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:31.999285 tst mo_mt_sms.py: using LAC 23543 20:32:32.129332 tst mo_mt_sms.py: using RAC 83 20:32:32.252875 tst mo_mt_sms.py: using CellId 23543 20:32:32.378930 tst mo_mt_sms.py: using BVCI 23544 20:32:32.490635 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:32.610005 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:32.725906 tst mo_mt_sms.py:9: start nitb and bts... 20:32:32.930274 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:32:33.546482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12116): Launched 20:32:33.849980 run osmo-nitb_10.42.42.2(pid=12117): Launched 20:32:34.019505 run osmo-nitb_10.42.42.2(pid=12117): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12117)] 20:32:34.155331 run osmo-nitb_10.42.42.2(pid=12117): stdout: | (launched: 2022-12-09_20:32:33.794389) 20:32:34.291890 run osmo-nitb_10.42.42.2(pid=12117): stderr: | (launched: 2022-12-09_20:32:33.839160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:34.428689 run osmo-nitb_10.42.42.2(pid=12117): stdout: | (launched: 2022-12-09_20:32:33.794389) 20:32:34.560468 run osmo-nitb_10.42.42.2(pid=12117): stderr: | (launched: 2022-12-09_20:32:33.839160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12117) [trial-2364↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12117)] 20:32:34.965897 tst osmo-nitb_10.42.42.2(pid=12117): stdout: | (launched: 2022-12-09_20:32:33.794389) 20:32:35.088468 tst osmo-nitb_10.42.42.2(pid=12117): stderr: | (launched: 2022-12-09_20:32:33.839160) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:35.232680 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12117) [trial-2364↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12117)] [trial-2364↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 20:32:35.241592 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 20:32:35.248425 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12116): Terminating (SIGTERM) 20:32:35.459748 --- ParallelTerminationStrategy: PID 12116 died... 20:32:35.480527 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12116): Terminated: ok {rc=0} 20:32:35.568642 bus /sierra_3: Setting Powered False 20:32:36.670642 bus /sierra_3: Setting Powered False 20:32:37.787126 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:38.984167 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:38.988427 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:39.022325 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:32:39.048903 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:32:39.100828 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:39.134759 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:32:39.161294 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:32:39.707851 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 20:32:39.712658 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:39.723414 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:39.771244 tst mo_mt_sms.py: using LAC 23544 20:32:39.890885 tst mo_mt_sms.py: using RAC 84 20:32:40.008668 tst mo_mt_sms.py: using CellId 23544 20:32:40.127066 tst mo_mt_sms.py: using BVCI 23545 20:32:40.237689 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:40.248436 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:40.259013 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:40.269822 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:40.280475 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:40.291222 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:40.411948 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:32:40.528938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:40.998388 run create_hlr_db(pid=12121): Launched 20:32:41.115248 bus /sierra_2: Setting Powered False 20:32:42.175370 run create_hlr_db(pid=12121): Terminated: ok {rc=0} 20:32:42.595801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Launched 20:32:42.896586 run osmo-hlr_10.42.42.2(pid=12124): Launched 20:32:43.010897 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:43.540898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Launched 20:32:43.840790 run osmo-stp_10.42.42.5(pid=12127): Launched 20:32:43.954959 run osmo-msc_10.42.42.6: Starting osmo-msc 20:32:44.499116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Launched 20:32:44.800190 run osmo-msc_10.42.42.6(pid=12130): Launched 20:32:44.968528 run osmo-stp_10.42.42.5(pid=12127): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] 20:32:45.096114 run osmo-stp_10.42.42.5(pid=12127): stdout: | (launched: 2022-12-09_20:32:43.785285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:45.224331 run osmo-stp_10.42.42.5(pid=12127): stderr: | 20221209203243953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203243953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203243953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203243954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203243954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203243954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203243954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:45.350521 run osmo-stp_10.42.42.5(pid=12127): stdout: | (launched: 2022-12-09_20:32:43.785285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:32:45.470519 run osmo-stp_10.42.42.5(pid=12127): stderr: | 20221209203243953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203243953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203243953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203243954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203243954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203243954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203243954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:32:45.614719 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12127): Process ended prematurely: osmo-stp_10.42.42.5(pid=12127) [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 20:32:45.623287 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 20:32:45.650114 run osmo-hlr_10.42.42.2(pid=12124): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12124)] 20:32:45.697726 run osmo-hlr_10.42.42.2(pid=12124): stdout: | (launched: 2022-12-09_20:32:42.840935) 20:32:45.746730 run osmo-hlr_10.42.42.2(pid=12124): stderr: | 20221209203243020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203243020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203243020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203243020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203243020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203243020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203243033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203243041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203243042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203243042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:32:45.815477 run osmo-msc_10.42.42.6(pid=12130): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12130)] 20:32:45.884438 run osmo-msc_10.42.42.6(pid=12130): stdout: | (launched: 2022-12-09_20:32:44.744501) 20:32:45.935864 run osmo-msc_10.42.42.6(pid=12130): stderr: | 20221209203245017 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203245017 DLGLOBAL DEBUG validating counter group 0x7f93a42c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203245017 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203245017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203245018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203245018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203245019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203245020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203245020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203245020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:32:45.996169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminating (SIGTERM) 20:32:46.038141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Terminating (SIGTERM) 20:32:46.081941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Terminating (SIGTERM) 20:32:46.126608 --- ParallelTerminationStrategy: PID 12123 died... 20:32:46.147011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminated: ok {rc=0} 20:32:46.195725 --- ParallelTerminationStrategy: PID 12126 died... 20:32:46.216169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12126): Terminated: ok {rc=0} 20:32:46.264997 --- ParallelTerminationStrategy: PID 12129 died... 20:32:46.285597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12129): Terminated: ok {rc=0} 20:32:46.376586 bus /sierra_3: Setting Powered False 20:32:47.477381 bus /sierra_3: Setting Powered False 20:32:48.594649 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:49.825675 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:49.829541 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:49.864027 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 20:32:49.870937 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 20:32:49.906670 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:49.940787 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 20:32:49.947668 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 20:32:50.466751 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 20:32:50.471874 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 20:32:50.482953 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:50.534600 tst assert_extension.py: using LAC 23545 20:32:50.652174 tst assert_extension.py: using RAC 85 20:32:50.768707 tst assert_extension.py: using CellId 23545 20:32:50.885326 tst assert_extension.py: using BVCI 23546 20:32:50.994300 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 20:32:51.112771 tst assert_extension.py:10: start nitb and bts... 20:32:51.329867 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:32:51.989468 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12135): Launched 20:32:52.313743 run osmo-nitb_10.42.42.2(pid=12136): Launched 20:32:52.494150 run osmo-nitb_10.42.42.2(pid=12136): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12136)] 20:32:52.639037 run osmo-nitb_10.42.42.2(pid=12136): stdout: | (launched: 2022-12-09_20:32:52.254248) 20:32:52.784537 run osmo-nitb_10.42.42.2(pid=12136): stderr: | (launched: 2022-12-09_20:32:52.302597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:52.930727 run osmo-nitb_10.42.42.2(pid=12136): stdout: | (launched: 2022-12-09_20:32:52.254248) 20:32:53.071722 run osmo-nitb_10.42.42.2(pid=12136): stderr: | (launched: 2022-12-09_20:32:52.302597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12136) [trial-2364↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12136)] 20:32:53.437359 tst osmo-nitb_10.42.42.2(pid=12136): stdout: | (launched: 2022-12-09_20:32:52.254248) 20:32:53.567524 tst osmo-nitb_10.42.42.2(pid=12136): stderr: | (launched: 2022-12-09_20:32:52.302597) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:32:53.721995 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12136) [trial-2364↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12136)] [trial-2364↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 20:32:53.731130 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:32:53.738447 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12135): Terminating (SIGTERM) 20:32:53.949426 --- ParallelTerminationStrategy: PID 12135 died... 20:32:53.970912 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12135): Terminated: ok {rc=0} 20:32:54.058793 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 20:32:55.241980 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:32:55.246724 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:32:55.281665 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:32:55.309076 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 20:32:55.344667 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:32:55.379256 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:32:55.406538 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 20:32:55.936379 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 20:32:55.941593 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:55.952223 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:32:55.999753 tst assert_extension.py: using LAC 23546 20:32:56.129734 tst assert_extension.py: using RAC 86 20:32:56.257802 tst assert_extension.py: using CellId 23546 20:32:56.385672 tst assert_extension.py: using BVCI 23547 20:32:56.503851 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:56.515164 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:56.526201 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:56.537090 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:56.548418 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:32:56.559534 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 20:32:56.675111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:32:57.142141 run create_hlr_db(pid=12140): Launched 20:32:57.257990 bus /sierra_2: Setting Powered False 20:32:58.317683 run create_hlr_db(pid=12140): Terminated: ok {rc=0} 20:32:58.737798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12142): Launched 20:32:59.040131 run osmo-hlr_10.42.42.2(pid=12143): Launched 20:32:59.157734 run osmo-stp_10.42.42.5: Starting osmo-stp 20:32:59.793825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12145): Launched 20:33:00.091623 run osmo-stp_10.42.42.5(pid=12146): Launched 20:33:00.205348 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:00.742481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12148): Launched 20:33:01.077137 run osmo-msc_10.42.42.6(pid=12149): Launched 20:33:01.470806 run osmo-stp_10.42.42.5(pid=12146): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12146)] 20:33:01.822291 run osmo-stp_10.42.42.5(pid=12146): stdout: | (launched: 2022-12-09_20:33:00.036388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:01.949150 run osmo-stp_10.42.42.5(pid=12146): stderr: | 20221209203300207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203300207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203300207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203300208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203300208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203300208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203300208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:02.076039 run osmo-stp_10.42.42.5(pid=12146): stdout: | (launched: 2022-12-09_20:33:00.036388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:02.197120 run osmo-stp_10.42.42.5(pid=12146): stderr: | 20221209203300207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203300207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203300207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203300208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203300208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203300208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203300208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:02.342283 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12146): Process ended prematurely: osmo-stp_10.42.42.5(pid=12146) [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12146)] [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py:17] 20:33:02.350883 tst assert_extension.py:17: Test FAILED (6.4 sec) 20:33:02.378201 run osmo-hlr_10.42.42.2(pid=12143): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12143)] 20:33:02.429080 run osmo-hlr_10.42.42.2(pid=12143): stdout: | (launched: 2022-12-09_20:32:58.983696) 20:33:02.480532 run osmo-hlr_10.42.42.2(pid=12143): stderr: | 20221209203259161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203259161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203259161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203259161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203259162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203259162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203259174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203259184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203259184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203259185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:02.549780 run osmo-msc_10.42.42.6(pid=12149): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12149)] 20:33:02.597904 run osmo-msc_10.42.42.6(pid=12149): stdout: | (launched: 2022-12-09_20:33:01.010185) 20:33:02.647680 run osmo-msc_10.42.42.6(pid=12149): stderr: | 20221209203301504 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203301504 DLGLOBAL DEBUG validating counter group 0x7ff5c6630c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203301504 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203301504 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203301506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203301506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203301510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203301511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203301512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203301513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:02.698212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12142): Terminating (SIGTERM) 20:33:02.738296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12145): Terminating (SIGTERM) 20:33:02.778321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12148): Terminating (SIGTERM) 20:33:02.818537 --- ParallelTerminationStrategy: PID 12142 died... 20:33:02.837653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12142): Terminated: ok {rc=0} 20:33:02.882183 --- ParallelTerminationStrategy: PID 12145 died... 20:33:02.900744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12145): Terminated: ok {rc=0} 20:33:02.945228 --- ParallelTerminationStrategy: PID 12148 died... 20:33:02.963736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12148): Terminated: ok {rc=0} 20:33:03.047866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:33:04.261317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:04.267794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:33:04.301900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:33:04.328273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:33:04.381242 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:33:04.415174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:33:04.441115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:33:04.991708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:33:05.045558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.057383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:33:05.129425 tst mo_mt_call.py: using LAC 23547 20:33:05.249293 tst mo_mt_call.py: using RAC 87 20:33:05.369366 tst mo_mt_call.py: using CellId 23547 20:33:05.488490 tst mo_mt_call.py: using BVCI 23548 20:33:05.598117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.609229 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.620107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.631358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.642701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:05.653827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:05.773580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:05.894899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:06.397731 run create_hlr_db(pid=12155): Launched 20:33:06.530225 bus /sierra_2: Setting Powered False 20:33:07.594606 run create_hlr_db(pid=12155): Terminated: ok {rc=0} 20:33:08.027829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Launched 20:33:08.332552 run osmo-hlr_10.42.42.2(pid=12158): Launched 20:33:08.449986 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:08.984777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Launched 20:33:09.287589 run osmo-stp_10.42.42.5(pid=12161): Launched 20:33:09.403563 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:09.951248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Launched 20:33:10.254157 run osmo-msc_10.42.42.6(pid=12164): Launched 20:33:10.424103 run osmo-stp_10.42.42.5(pid=12161): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] 20:33:10.552392 run osmo-stp_10.42.42.5(pid=12161): stdout: | (launched: 2022-12-09_20:33:09.231706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:10.680563 run osmo-stp_10.42.42.5(pid=12161): stderr: | 20221209203309403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203309403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203309403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203309403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203309404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203309404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203309404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:10.806077 run osmo-stp_10.42.42.5(pid=12161): stdout: | (launched: 2022-12-09_20:33:09.231706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:10.926727 run osmo-stp_10.42.42.5(pid=12161): stderr: | 20221209203309403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203309403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203309403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203309403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203309404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203309404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203309404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:11.071290 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12161): Process ended prematurely: osmo-stp_10.42.42.5(pid=12161) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:33:11.080204 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:33:11.106771 run osmo-hlr_10.42.42.2(pid=12158): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12158)] 20:33:11.154637 run osmo-hlr_10.42.42.2(pid=12158): stdout: | (launched: 2022-12-09_20:33:08.276363) 20:33:11.203729 run osmo-hlr_10.42.42.2(pid=12158): stderr: | 20221209203308454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203308454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203308454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203308454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203308454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203308454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203308466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203308477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203308477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203308477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:11.272264 run osmo-msc_10.42.42.6(pid=12164): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12164)] 20:33:11.320009 run osmo-msc_10.42.42.6(pid=12164): stdout: | (launched: 2022-12-09_20:33:10.198415) 20:33:11.369272 run osmo-msc_10.42.42.6(pid=12164): stderr: | 20221209203310471 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203310471 DLGLOBAL DEBUG validating counter group 0x7fdff3c46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203310471 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203310471 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203310471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203310472 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203310473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203310474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203310474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203310474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:11.419028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Terminating (SIGTERM) 20:33:11.458387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Terminating (SIGTERM) 20:33:11.497820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Terminating (SIGTERM) 20:33:11.537514 --- ParallelTerminationStrategy: PID 12157 died... 20:33:11.556339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12157): Terminated: ok {rc=0} 20:33:11.600059 --- ParallelTerminationStrategy: PID 12160 died... 20:33:11.618324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12160): Terminated: ok {rc=0} 20:33:11.661851 --- ParallelTerminationStrategy: PID 12163 died... 20:33:11.680158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12163): Terminated: ok {rc=0} 20:33:11.765362 bus /sierra_3: Setting Powered False 20:33:12.863501 bus /sierra_3: Setting Powered False 20:33:13.979696 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:33:15.126135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.138018 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:33:15.207418 tst mo_mt_call_osmux.py: using LAC 23548 20:33:15.328385 tst mo_mt_call_osmux.py: using RAC 88 20:33:15.446329 tst mo_mt_call_osmux.py: using CellId 23548 20:33:15.566354 tst mo_mt_call_osmux.py: using BVCI 23549 20:33:15.678407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.689628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.700570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.711795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.723046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:33:15.734187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:15.856817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:33:15.990761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:16.476900 run create_hlr_db(pid=12166): Launched 20:33:16.629137 bus /sierra_2: Setting Powered False 20:33:17.689510 run create_hlr_db(pid=12166): Terminated: ok {rc=0} 20:33:18.134054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Launched 20:33:18.461120 run osmo-hlr_10.42.42.2(pid=12169): Launched 20:33:18.587661 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:19.152483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Launched 20:33:19.477274 run osmo-stp_10.42.42.5(pid=12172): Launched 20:33:19.600742 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:20.187158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12174): Launched 20:33:20.512741 run osmo-msc_10.42.42.6(pid=12175): Launched 20:33:20.693787 run osmo-stp_10.42.42.5(pid=12172): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] 20:33:20.830533 run osmo-stp_10.42.42.5(pid=12172): stdout: | (launched: 2022-12-09_20:33:19.417556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:20.967689 run osmo-stp_10.42.42.5(pid=12172): stderr: | 20221209203319610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203319610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203319610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203319611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203319611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203319611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203319611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:21.104203 run osmo-stp_10.42.42.5(pid=12172): stdout: | (launched: 2022-12-09_20:33:19.417556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:21.234139 run osmo-stp_10.42.42.5(pid=12172): stderr: | 20221209203319610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203319610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203319610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203319611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203319611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203319611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203319611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:21.389182 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12172): Process ended prematurely: osmo-stp_10.42.42.5(pid=12172) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:33:21.398953 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:33:21.426642 run osmo-hlr_10.42.42.2(pid=12169): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12169)] 20:33:21.477125 run osmo-hlr_10.42.42.2(pid=12169): stdout: | (launched: 2022-12-09_20:33:18.401858) 20:33:21.529066 run osmo-hlr_10.42.42.2(pid=12169): stderr: | 20221209203318601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203318601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203318601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203318601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203318601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203318602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203318614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203318622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203318622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203318622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:21.601454 run osmo-msc_10.42.42.6(pid=12175): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12175)] 20:33:21.651600 run osmo-msc_10.42.42.6(pid=12175): stdout: | (launched: 2022-12-09_20:33:20.453145) 20:33:21.703078 run osmo-msc_10.42.42.6(pid=12175): stderr: | 20221209203320776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203320776 DLGLOBAL DEBUG validating counter group 0x7f94c3ef2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203320776 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203320776 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203320777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203320777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203320778 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203320779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203320779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203320779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:21.755116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Terminating (SIGTERM) 20:33:21.796765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Terminating (SIGTERM) 20:33:21.838598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12174): Terminating (SIGTERM) 20:33:21.880551 --- ParallelTerminationStrategy: PID 12168 died... 20:33:21.900508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Terminated: ok {rc=0} 20:33:21.946592 --- ParallelTerminationStrategy: PID 12171 died... 20:33:21.966125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Terminated: ok {rc=0} 20:33:22.012199 --- ParallelTerminationStrategy: PID 12174 died... 20:33:22.031602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12174): Terminated: ok {rc=0} 20:33:22.119677 bus /sierra_3: Setting Powered False 20:33:23.219230 bus /sierra_3: Setting Powered False 20:33:24.337755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:33:25.587146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:25.593505 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:33:25.627425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:33:25.653929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:33:25.706433 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:33:25.740858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:33:25.767263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:33:26.316527 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:33:26.365920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.377104 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:33:26.446378 tst mo_mt_call.py: using LAC 23549 20:33:26.565096 tst mo_mt_call.py: using RAC 89 20:33:26.683800 tst mo_mt_call.py: using CellId 23549 20:33:26.801959 tst mo_mt_call.py: using BVCI 23550 20:33:26.913821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.924845 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.935965 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.947165 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.958507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:26.969752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:27.089992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:27.210750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:27.714964 run create_hlr_db(pid=12180): Launched 20:33:27.846578 bus /sierra_2: Setting Powered False 20:33:28.910209 run create_hlr_db(pid=12180): Terminated: ok {rc=0} 20:33:29.362661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Launched 20:33:29.688288 run osmo-hlr_10.42.42.2(pid=12183): Launched 20:33:29.812304 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:30.369777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Launched 20:33:30.694527 run osmo-stp_10.42.42.5(pid=12186): Launched 20:33:30.817744 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:31.547750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Launched 20:33:31.878023 run osmo-msc_10.42.42.6(pid=12189): Launched 20:33:32.160646 run osmo-stp_10.42.42.5(pid=12186): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] 20:33:32.315647 run osmo-stp_10.42.42.5(pid=12186): stdout: | (launched: 2022-12-09_20:33:30.634867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:32.449237 run osmo-stp_10.42.42.5(pid=12186): stderr: | 20221209203330831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203330831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203330831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203330832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203330840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203330841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203330841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:32.578013 run osmo-stp_10.42.42.5(pid=12186): stdout: | (launched: 2022-12-09_20:33:30.634867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:32.699983 run osmo-stp_10.42.42.5(pid=12186): stderr: | 20221209203330831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203330831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203330831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203330832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203330840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203330841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203330841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:32.845924 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12186): Process ended prematurely: osmo-stp_10.42.42.5(pid=12186) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:33:32.855265 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 20:33:32.883334 run osmo-hlr_10.42.42.2(pid=12183): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12183)] 20:33:32.932066 run osmo-hlr_10.42.42.2(pid=12183): stdout: | (launched: 2022-12-09_20:33:29.629182) 20:33:32.982321 run osmo-hlr_10.42.42.2(pid=12183): stderr: | 20221209203329829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203329829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203329829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203329829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203329829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203329829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203329841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203329849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203329849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203329849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:33.052119 run osmo-msc_10.42.42.6(pid=12189): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12189)] 20:33:33.100803 run osmo-msc_10.42.42.6(pid=12189): stdout: | (launched: 2022-12-09_20:33:31.818719) 20:33:33.151086 run osmo-msc_10.42.42.6(pid=12189): stderr: | 20221209203332306 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203332307 DLGLOBAL DEBUG validating counter group 0x7f1f5c934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203332307 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203332307 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203332307 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203332307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203332309 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203332309 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203332310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203332310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:33.201738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Terminating (SIGTERM) 20:33:33.242234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Terminating (SIGTERM) 20:33:33.282802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Terminating (SIGTERM) 20:33:33.323407 --- ParallelTerminationStrategy: PID 12182 died... 20:33:33.342364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12182): Terminated: ok {rc=0} 20:33:33.387896 --- ParallelTerminationStrategy: PID 12185 died... 20:33:33.406511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12185): Terminated: ok {rc=0} 20:33:33.451757 --- ParallelTerminationStrategy: PID 12188 died... 20:33:33.470364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12188): Terminated: ok {rc=0} 20:33:33.557949 bus /sierra_3: Setting Powered False 20:33:34.656573 bus /sierra_3: Setting Powered False 20:33:35.769471 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:33:36.912077 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:36.923812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:33:36.993840 tst mo_mt_call_osmux.py: using LAC 23550 20:33:37.114602 tst mo_mt_call_osmux.py: using RAC 90 20:33:37.242729 tst mo_mt_call_osmux.py: using CellId 23550 20:33:37.371966 tst mo_mt_call_osmux.py: using BVCI 23551 20:33:37.491945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:37.503829 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:37.515488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:37.527103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:37.538815 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:33:37.550427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:37.672832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:33:37.792076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:38.262581 run create_hlr_db(pid=12191): Launched 20:33:38.379442 bus /sierra_2: Setting Powered False 20:33:39.440321 run create_hlr_db(pid=12191): Terminated: ok {rc=0} 20:33:39.862962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12193): Launched 20:33:40.166949 run osmo-hlr_10.42.42.2(pid=12194): Launched 20:33:40.283374 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:40.821073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12196): Launched 20:33:41.125717 run osmo-stp_10.42.42.5(pid=12197): Launched 20:33:41.243306 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:41.795091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12199): Launched 20:33:42.101565 run osmo-msc_10.42.42.6(pid=12200): Launched 20:33:42.273545 run osmo-stp_10.42.42.5(pid=12197): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12197)] 20:33:42.403176 run osmo-stp_10.42.42.5(pid=12197): stdout: | (launched: 2022-12-09_20:33:41.069850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:42.532477 run osmo-stp_10.42.42.5(pid=12197): stderr: | 20221209203341239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203341239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203341239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203341239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203341240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203341240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203341240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:42.660424 run osmo-stp_10.42.42.5(pid=12197): stdout: | (launched: 2022-12-09_20:33:41.069850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:42.782321 run osmo-stp_10.42.42.5(pid=12197): stderr: | 20221209203341239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203341239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203341239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203341239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203341240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203341240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203341240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:42.927509 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12197): Process ended prematurely: osmo-stp_10.42.42.5(pid=12197) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12197)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:33:42.936822 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:33:42.963553 run osmo-hlr_10.42.42.2(pid=12194): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12194)] 20:33:43.011833 run osmo-hlr_10.42.42.2(pid=12194): stdout: | (launched: 2022-12-09_20:33:40.111119) 20:33:43.061200 run osmo-hlr_10.42.42.2(pid=12194): stderr: | 20221209203340287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203340287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203340288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203340288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203340288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203340288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203340302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203340313 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203340313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203340313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:43.130276 run osmo-msc_10.42.42.6(pid=12200): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12200)] 20:33:43.177866 run osmo-msc_10.42.42.6(pid=12200): stdout: | (launched: 2022-12-09_20:33:42.045501) 20:33:43.227558 run osmo-msc_10.42.42.6(pid=12200): stderr: | 20221209203342317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203342317 DLGLOBAL DEBUG validating counter group 0x7f680169ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203342317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203342317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203342317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203342318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203342319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203342320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203342320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203342320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:43.277438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12193): Terminating (SIGTERM) 20:33:43.317477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12196): Terminating (SIGTERM) 20:33:43.357283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12199): Terminating (SIGTERM) 20:33:43.397722 --- ParallelTerminationStrategy: PID 12193 died... 20:33:43.416606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12193): Terminated: ok {rc=0} 20:33:43.460673 --- ParallelTerminationStrategy: PID 12196 died... 20:33:43.479361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12196): Terminated: ok {rc=0} 20:33:43.523305 --- ParallelTerminationStrategy: PID 12199 died... 20:33:43.541649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12199): Terminated: ok {rc=0} 20:33:43.627321 bus /sierra_3: Setting Powered False 20:33:44.726691 bus /sierra_3: Setting Powered False 20:33:45.842187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:33:47.113858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:33:47.120329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:33:47.157133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:33:47.185320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:33:47.237756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:33:47.282521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:33:47.310592 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:33:47.849683 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:33:47.899114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:47.910567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:33:47.983022 tst mo_mt_call.py: using LAC 23551 20:33:48.102066 tst mo_mt_call.py: using RAC 91 20:33:48.220254 tst mo_mt_call.py: using CellId 23551 20:33:48.338450 tst mo_mt_call.py: using BVCI 23552 20:33:48.451126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:48.462425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:48.473485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:48.484787 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:48.496043 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:48.507618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:48.628627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:48.748518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:49.254422 run create_hlr_db(pid=12206): Launched 20:33:49.389196 bus /sierra_2: Setting Powered False 20:33:50.453356 run create_hlr_db(pid=12206): Terminated: ok {rc=0} 20:33:50.887929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12208): Launched 20:33:51.193314 run osmo-hlr_10.42.42.2(pid=12209): Launched 20:33:51.308701 run osmo-stp_10.42.42.5: Starting osmo-stp 20:33:51.832119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12211): Launched 20:33:52.136196 run osmo-stp_10.42.42.5(pid=12212): Launched 20:33:52.252891 run osmo-msc_10.42.42.6: Starting osmo-msc 20:33:52.804632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12214): Launched 20:33:53.110286 run osmo-msc_10.42.42.6(pid=12215): Launched 20:33:53.280415 run osmo-stp_10.42.42.5(pid=12212): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12212)] 20:33:53.409801 run osmo-stp_10.42.42.5(pid=12212): stdout: | (launched: 2022-12-09_20:33:52.080158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:53.539986 run osmo-stp_10.42.42.5(pid=12212): stderr: | 20221209203352252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203352253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203352253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203352253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203352254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203352254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203352254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:53.667347 run osmo-stp_10.42.42.5(pid=12212): stdout: | (launched: 2022-12-09_20:33:52.080158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:33:53.788518 run osmo-stp_10.42.42.5(pid=12212): stderr: | 20221209203352252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203352253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203352253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203352253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203352254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203352254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203352254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:33:53.934196 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12212): Process ended prematurely: osmo-stp_10.42.42.5(pid=12212) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12212)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:33:53.943440 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:33:53.970607 run osmo-hlr_10.42.42.2(pid=12209): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12209)] 20:33:54.018394 run osmo-hlr_10.42.42.2(pid=12209): stdout: | (launched: 2022-12-09_20:33:51.137259) 20:33:54.068062 run osmo-hlr_10.42.42.2(pid=12209): stderr: | 20221209203351316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203351316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203351316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203351316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203351316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203351317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203351332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203351342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203351342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203351342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:33:54.137695 run osmo-msc_10.42.42.6(pid=12215): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12215)] 20:33:54.185553 run osmo-msc_10.42.42.6(pid=12215): stdout: | (launched: 2022-12-09_20:33:53.054223) 20:33:54.234817 run osmo-msc_10.42.42.6(pid=12215): stderr: | 20221209203353328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203353328 DLGLOBAL DEBUG validating counter group 0x7fa193c37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203353328 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203353328 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203353329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203353329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203353331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203353331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203353331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203353331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:33:54.284910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12208): Terminating (SIGTERM) 20:33:54.324854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12211): Terminating (SIGTERM) 20:33:54.364829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12214): Terminating (SIGTERM) 20:33:54.404896 --- ParallelTerminationStrategy: PID 12208 died... 20:33:54.423964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12208): Terminated: ok {rc=0} 20:33:54.468220 --- ParallelTerminationStrategy: PID 12211 died... 20:33:54.486780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12211): Terminated: ok {rc=0} 20:33:54.531177 --- ParallelTerminationStrategy: PID 12214 died... 20:33:54.549781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12214): Terminated: ok {rc=0} 20:33:54.633735 bus /sierra_3: Setting Powered False 20:33:55.732728 bus /sierra_3: Setting Powered False 20:33:56.851081 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:33:57.997862 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.009920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:33:58.080637 tst mo_mt_call_osmux.py: using LAC 23552 20:33:58.203195 tst mo_mt_call_osmux.py: using RAC 92 20:33:58.327797 tst mo_mt_call_osmux.py: using CellId 23552 20:33:58.456135 tst mo_mt_call_osmux.py: using BVCI 23553 20:33:58.569687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.581334 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.592442 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.604186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.615885 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:33:58.627449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:58.744577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:33:58.865138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:33:59.370967 run create_hlr_db(pid=12217): Launched 20:33:59.503963 bus /sierra_2: Setting Powered False 20:34:00.568832 run create_hlr_db(pid=12217): Terminated: ok {rc=0} 20:34:01.016722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12223): Launched 20:34:01.435053 run osmo-hlr_10.42.42.2(pid=12224): Launched 20:34:01.724508 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:02.508586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12226): Launched 20:34:02.814832 run osmo-stp_10.42.42.5(pid=12227): Launched 20:34:02.931272 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:03.501058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12229): Launched 20:34:03.806361 run osmo-msc_10.42.42.6(pid=12230): Launched 20:34:03.979219 run osmo-stp_10.42.42.5(pid=12227): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12227)] 20:34:04.108858 run osmo-stp_10.42.42.5(pid=12227): stdout: | (launched: 2022-12-09_20:34:02.758921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:04.238130 run osmo-stp_10.42.42.5(pid=12227): stderr: | 20221209203402929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203402930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203402930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203402930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203402931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203402931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203402931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:04.365654 run osmo-stp_10.42.42.5(pid=12227): stdout: | (launched: 2022-12-09_20:34:02.758921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:04.488046 run osmo-stp_10.42.42.5(pid=12227): stderr: | 20221209203402929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203402930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203402930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203402930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203402931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203402931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203402931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:04.633931 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12227): Process ended prematurely: osmo-stp_10.42.42.5(pid=12227) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12227)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:34:04.643005 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:34:04.669728 run osmo-hlr_10.42.42.2(pid=12224): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12224)] 20:34:04.717870 run osmo-hlr_10.42.42.2(pid=12224): stdout: | (launched: 2022-12-09_20:34:01.376541) 20:34:04.767475 run osmo-hlr_10.42.42.2(pid=12224): stderr: | 20221209203401716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203401717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203401717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203401717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203401718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203401719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203401743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203401764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203401764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203401764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:04.836133 run osmo-msc_10.42.42.6(pid=12230): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12230)] 20:34:04.883405 run osmo-msc_10.42.42.6(pid=12230): stdout: | (launched: 2022-12-09_20:34:03.750035) 20:34:04.932904 run osmo-msc_10.42.42.6(pid=12230): stderr: | 20221209203404020 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203404020 DLGLOBAL DEBUG validating counter group 0x7f6ea138dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203404021 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203404021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203404021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203404021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203404023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203404023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203404023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203404023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:04.982646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12223): Terminating (SIGTERM) 20:34:05.022072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12226): Terminating (SIGTERM) 20:34:05.061461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12229): Terminating (SIGTERM) 20:34:05.101278 --- ParallelTerminationStrategy: PID 12223 died... 20:34:05.120189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12223): Terminated: ok {rc=0} 20:34:05.164661 --- ParallelTerminationStrategy: PID 12226 died... 20:34:05.183120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12226): Terminated: ok {rc=0} 20:34:05.227767 --- ParallelTerminationStrategy: PID 12229 died... 20:34:05.246516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12229): Terminated: ok {rc=0} 20:34:05.332254 bus /sierra_3: Setting Powered False 20:34:06.431501 bus /sierra_3: Setting Powered False 20:34:07.547042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:34:08.802732 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:34:08.809747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:34:08.844262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:34:08.871563 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:34:08.926031 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:34:08.960887 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:34:08.988131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:34:09.547396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:34:09.600650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:09.612295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:34:09.682606 tst mo_mt_call.py: using LAC 23553 20:34:09.807891 tst mo_mt_call.py: using RAC 93 20:34:09.928205 tst mo_mt_call.py: using CellId 23553 20:34:10.045630 tst mo_mt_call.py: using BVCI 23554 20:34:10.156183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:10.167542 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:10.178692 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:10.190110 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:10.201605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:10.212905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:10.330328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:10.451697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:10.958202 run create_hlr_db(pid=12235): Launched 20:34:11.091942 bus /sierra_2: Setting Powered False 20:34:12.156491 run create_hlr_db(pid=12235): Terminated: ok {rc=0} 20:34:12.608669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12237): Launched 20:34:12.934165 run osmo-hlr_10.42.42.2(pid=12238): Launched 20:34:13.059257 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:13.622855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12240): Launched 20:34:13.949218 run osmo-stp_10.42.42.5(pid=12241): Launched 20:34:14.073379 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:14.663085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12243): Launched 20:34:14.990693 run osmo-msc_10.42.42.6(pid=12244): Launched 20:34:15.174532 run osmo-stp_10.42.42.5(pid=12241): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12241)] 20:34:15.311604 run osmo-stp_10.42.42.5(pid=12241): stdout: | (launched: 2022-12-09_20:34:13.889451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:15.449222 run osmo-stp_10.42.42.5(pid=12241): stderr: | 20221209203414086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203414086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203414086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203414087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203414087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203414087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203414087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:15.585508 run osmo-stp_10.42.42.5(pid=12241): stdout: | (launched: 2022-12-09_20:34:13.889451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:15.715220 run osmo-stp_10.42.42.5(pid=12241): stderr: | 20221209203414086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203414086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203414086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203414087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203414087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203414087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203414087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:15.875996 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12241): Process ended prematurely: osmo-stp_10.42.42.5(pid=12241) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12241)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:34:15.893164 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:34:15.925917 run osmo-hlr_10.42.42.2(pid=12238): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12238)] 20:34:15.975905 run osmo-hlr_10.42.42.2(pid=12238): stdout: | (launched: 2022-12-09_20:34:12.874696) 20:34:16.028214 run osmo-hlr_10.42.42.2(pid=12238): stderr: | 20221209203413074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203413074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203413074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203413075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203413075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203413075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203413089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203413098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203413098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203413098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:16.101818 run osmo-msc_10.42.42.6(pid=12244): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12244)] 20:34:16.152561 run osmo-msc_10.42.42.6(pid=12244): stdout: | (launched: 2022-12-09_20:34:14.930955) 20:34:16.204213 run osmo-msc_10.42.42.6(pid=12244): stderr: | 20221209203415254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203415254 DLGLOBAL DEBUG validating counter group 0x7fe127eddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203415254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203415255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203415255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203415255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203415257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203415257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203415257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203415257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:16.257587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12237): Terminating (SIGTERM) 20:34:16.300016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12240): Terminating (SIGTERM) 20:34:16.344137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12243): Terminating (SIGTERM) 20:34:16.389139 --- ParallelTerminationStrategy: PID 12237 died... 20:34:16.408978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12237): Terminated: ok {rc=0} 20:34:16.458664 --- ParallelTerminationStrategy: PID 12240 died... 20:34:16.478139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12240): Terminated: ok {rc=0} 20:34:16.525509 --- ParallelTerminationStrategy: PID 12243 died... 20:34:16.544920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12243): Terminated: ok {rc=0} 20:34:16.633578 bus /sierra_3: Setting Powered False 20:34:17.733407 bus /sierra_3: Setting Powered False 20:34:18.848411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:34:19.994920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.006831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:34:20.076769 tst mo_mt_call_osmux.py: using LAC 23554 20:34:20.196354 tst mo_mt_call_osmux.py: using RAC 94 20:34:20.317103 tst mo_mt_call_osmux.py: using CellId 23554 20:34:20.437496 tst mo_mt_call_osmux.py: using BVCI 23555 20:34:20.558468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.570166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.581720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.593650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.605675 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:34:20.617522 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:20.734678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:34:20.851233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:21.323434 run create_hlr_db(pid=12246): Launched 20:34:21.439904 bus /sierra_2: Setting Powered False 20:34:22.500161 run create_hlr_db(pid=12246): Terminated: ok {rc=0} 20:34:22.945877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12248): Launched 20:34:23.272814 run osmo-hlr_10.42.42.2(pid=12249): Launched 20:34:23.398991 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:23.965697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12251): Launched 20:34:24.293941 run osmo-stp_10.42.42.5(pid=12252): Launched 20:34:24.418452 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:25.010339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12254): Launched 20:34:25.338288 run osmo-msc_10.42.42.6(pid=12255): Launched 20:34:25.520340 run osmo-stp_10.42.42.5(pid=12252): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12252)] 20:34:25.657661 run osmo-stp_10.42.42.5(pid=12252): stdout: | (launched: 2022-12-09_20:34:24.233671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:25.795192 run osmo-stp_10.42.42.5(pid=12252): stderr: | 20221209203424426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203424426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203424426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203424426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203424429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203424429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203424429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:25.931953 run osmo-stp_10.42.42.5(pid=12252): stdout: | (launched: 2022-12-09_20:34:24.233671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:26.062516 run osmo-stp_10.42.42.5(pid=12252): stderr: | 20221209203424426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203424426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203424426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203424426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203424429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203424429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203424429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:26.219086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12252): Process ended prematurely: osmo-stp_10.42.42.5(pid=12252) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12252)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:34:26.229060 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:34:26.256825 run osmo-hlr_10.42.42.2(pid=12249): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12249)] 20:34:26.306860 run osmo-hlr_10.42.42.2(pid=12249): stdout: | (launched: 2022-12-09_20:34:23.213072) 20:34:26.358761 run osmo-hlr_10.42.42.2(pid=12249): stderr: | 20221209203423410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203423410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203423410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203423410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203423410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203423410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203423423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203423432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203423432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203423432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:26.430567 run osmo-msc_10.42.42.6(pid=12255): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12255)] 20:34:26.480102 run osmo-msc_10.42.42.6(pid=12255): stdout: | (launched: 2022-12-09_20:34:25.277984) 20:34:26.531742 run osmo-msc_10.42.42.6(pid=12255): stderr: | 20221209203425602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203425602 DLGLOBAL DEBUG validating counter group 0x7f6f210afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203425602 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203425602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203425602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203425602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203425604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203425604 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203425605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203425605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:26.583615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12248): Terminating (SIGTERM) 20:34:26.624887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12251): Terminating (SIGTERM) 20:34:26.666351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12254): Terminating (SIGTERM) 20:34:26.708050 --- ParallelTerminationStrategy: PID 12248 died... 20:34:26.727894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12248): Terminated: ok {rc=0} 20:34:26.774342 --- ParallelTerminationStrategy: PID 12251 died... 20:34:26.793960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12251): Terminated: ok {rc=0} 20:34:26.839646 --- ParallelTerminationStrategy: PID 12254 died... 20:34:26.858982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12254): Terminated: ok {rc=0} 20:34:26.946725 bus /sierra_3: Setting Powered False 20:34:28.045138 bus /sierra_3: Setting Powered False 20:34:29.161686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:34:30.418808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:34:30.425603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:34:30.459803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:34:30.486991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:34:30.539077 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:34:30.573320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:34:30.600474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:34:31.153026 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:34:31.226264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.242073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:34:31.326850 tst mo_mt_call.py: using LAC 23555 20:34:31.453144 tst mo_mt_call.py: using RAC 95 20:34:31.575476 tst mo_mt_call.py: using CellId 23555 20:34:31.699833 tst mo_mt_call.py: using BVCI 23556 20:34:31.820531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.833157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.845216 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.858390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.870623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:31.882863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:32.029572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:32.155374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:32.681756 run create_hlr_db(pid=12260): Launched 20:34:32.815315 bus /sierra_2: Setting Powered False 20:34:33.879625 run create_hlr_db(pid=12260): Terminated: ok {rc=0} 20:34:34.335226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Launched 20:34:34.662810 run osmo-hlr_10.42.42.2(pid=12263): Launched 20:34:34.787941 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:35.353402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Launched 20:34:35.680300 run osmo-stp_10.42.42.5(pid=12266): Launched 20:34:35.804624 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:36.396011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12268): Launched 20:34:36.723038 run osmo-msc_10.42.42.6(pid=12269): Launched 20:34:36.906945 run osmo-stp_10.42.42.5(pid=12266): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] 20:34:37.045468 run osmo-stp_10.42.42.5(pid=12266): stdout: | (launched: 2022-12-09_20:34:35.620405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:37.184228 run osmo-stp_10.42.42.5(pid=12266): stderr: | 20221209203435813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203435813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203435814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203435814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203435814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203435814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203435814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:37.321355 run osmo-stp_10.42.42.5(pid=12266): stdout: | (launched: 2022-12-09_20:34:35.620405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:37.451553 run osmo-stp_10.42.42.5(pid=12266): stderr: | 20221209203435813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203435813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203435814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203435814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203435814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203435814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203435814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:37.607378 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12266): Process ended prematurely: osmo-stp_10.42.42.5(pid=12266) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:34:37.616934 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:34:37.644703 run osmo-hlr_10.42.42.2(pid=12263): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12263)] 20:34:37.694608 run osmo-hlr_10.42.42.2(pid=12263): stdout: | (launched: 2022-12-09_20:34:34.603311) 20:34:37.745873 run osmo-hlr_10.42.42.2(pid=12263): stderr: | 20221209203434803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203434803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203434803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203434803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203434804 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203434804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203434816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203434826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203434827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203434827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:37.817395 run osmo-msc_10.42.42.6(pid=12269): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12269)] 20:34:37.866982 run osmo-msc_10.42.42.6(pid=12269): stdout: | (launched: 2022-12-09_20:34:36.663300) 20:34:37.918374 run osmo-msc_10.42.42.6(pid=12269): stderr: | 20221209203436986 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203436986 DLGLOBAL DEBUG validating counter group 0x7fbbecc9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203436986 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203436986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203436987 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203436987 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203436988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203436989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203436989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203436989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:37.970104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Terminating (SIGTERM) 20:34:38.011593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Terminating (SIGTERM) 20:34:38.053095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12268): Terminating (SIGTERM) 20:34:38.094893 --- ParallelTerminationStrategy: PID 12262 died... 20:34:38.115026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12262): Terminated: ok {rc=0} 20:34:38.160908 --- ParallelTerminationStrategy: PID 12265 died... 20:34:38.180472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12265): Terminated: ok {rc=0} 20:34:38.226086 --- ParallelTerminationStrategy: PID 12268 died... 20:34:38.245493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12268): Terminated: ok {rc=0} 20:34:38.332813 bus /sierra_3: Setting Powered False 20:34:39.430560 bus /sierra_3: Setting Powered False 20:34:40.546620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:34:41.698217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:41.710850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:34:41.782538 tst mo_mt_call_osmux.py: using LAC 23556 20:34:41.912456 tst mo_mt_call_osmux.py: using RAC 96 20:34:42.041817 tst mo_mt_call_osmux.py: using CellId 23556 20:34:42.169481 tst mo_mt_call_osmux.py: using BVCI 23557 20:34:42.287852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:42.299611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:42.311115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:42.322627 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:42.334267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:34:42.345835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:42.464729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:34:42.581788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:43.055337 run create_hlr_db(pid=12271): Launched 20:34:43.173181 bus /sierra_2: Setting Powered False 20:34:44.234055 run create_hlr_db(pid=12271): Terminated: ok {rc=0} 20:34:44.659756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Launched 20:34:44.965295 run osmo-hlr_10.42.42.2(pid=12274): Launched 20:34:45.082556 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:45.618497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Launched 20:34:45.957212 run osmo-stp_10.42.42.5(pid=12277): Launched 20:34:46.246437 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:46.888485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Launched 20:34:47.215827 run osmo-msc_10.42.42.6(pid=12280): Launched 20:34:47.466450 run osmo-stp_10.42.42.5(pid=12277): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] 20:34:47.597958 run osmo-stp_10.42.42.5(pid=12277): stdout: | (launched: 2022-12-09_20:34:45.886606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:47.726680 run osmo-stp_10.42.42.5(pid=12277): stderr: | 20221209203446150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203446150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203446150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203446151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203446151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203446151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203446151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:47.854278 run osmo-stp_10.42.42.5(pid=12277): stdout: | (launched: 2022-12-09_20:34:45.886606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:47.975957 run osmo-stp_10.42.42.5(pid=12277): stderr: | 20221209203446150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203446150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203446150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203446151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203446151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203446151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203446151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:48.122216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12277): Process ended prematurely: osmo-stp_10.42.42.5(pid=12277) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:34:48.131574 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:34:48.158676 run osmo-hlr_10.42.42.2(pid=12274): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12274)] 20:34:48.206514 run osmo-hlr_10.42.42.2(pid=12274): stdout: | (launched: 2022-12-09_20:34:44.909306) 20:34:48.255952 run osmo-hlr_10.42.42.2(pid=12274): stderr: | 20221209203445085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203445085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203445085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203445085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203445085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203445085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203445099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203445108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203445108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203445108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:48.325165 run osmo-msc_10.42.42.6(pid=12280): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12280)] 20:34:48.372914 run osmo-msc_10.42.42.6(pid=12280): stdout: | (launched: 2022-12-09_20:34:47.156785) 20:34:48.422294 run osmo-msc_10.42.42.6(pid=12280): stderr: | 20221209203447439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203447440 DLGLOBAL DEBUG validating counter group 0x7f47efef7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203447440 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203447440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203447440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203447440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203447442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203447442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203447443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203447443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:48.472612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Terminating (SIGTERM) 20:34:48.512484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Terminating (SIGTERM) 20:34:48.552484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Terminating (SIGTERM) 20:34:48.592623 --- ParallelTerminationStrategy: PID 12273 died... 20:34:48.611670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12273): Terminated: ok {rc=0} 20:34:48.656400 --- ParallelTerminationStrategy: PID 12276 died... 20:34:48.674919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12276): Terminated: ok {rc=0} 20:34:48.718919 --- ParallelTerminationStrategy: PID 12279 died... 20:34:48.737383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12279): Terminated: ok {rc=0} 20:34:48.821578 bus /sierra_3: Setting Powered False 20:34:49.916352 bus /sierra_3: Setting Powered False 20:34:51.031916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:34:52.294467 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:34:52.302371 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:34:52.336461 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:34:52.363198 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:34:52.415643 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:34:52.449185 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:34:52.475129 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:34:53.026702 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:34:53.075639 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.086927 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:34:53.157583 tst mo_mt_call.py: using LAC 23557 20:34:53.278578 tst mo_mt_call.py: using RAC 97 20:34:53.399911 tst mo_mt_call.py: using CellId 23557 20:34:53.520801 tst mo_mt_call.py: using BVCI 23558 20:34:53.630638 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.641879 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.652800 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.664157 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.675456 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:34:53.686733 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:53.806138 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:34:53.927035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:34:54.431999 run create_hlr_db(pid=12285): Launched 20:34:54.563849 bus /sierra_2: Setting Powered False 20:34:55.627872 run create_hlr_db(pid=12285): Terminated: ok {rc=0} 20:34:56.062485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Launched 20:34:56.367915 run osmo-hlr_10.42.42.2(pid=12288): Launched 20:34:56.484134 run osmo-stp_10.42.42.5: Starting osmo-stp 20:34:57.019526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Launched 20:34:57.323753 run osmo-stp_10.42.42.5(pid=12291): Launched 20:34:57.439735 run osmo-msc_10.42.42.6: Starting osmo-msc 20:34:57.993464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12293): Launched 20:34:58.298465 run osmo-msc_10.42.42.6(pid=12294): Launched 20:34:58.469683 run osmo-stp_10.42.42.5(pid=12291): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] 20:34:58.598690 run osmo-stp_10.42.42.5(pid=12291): stdout: | (launched: 2022-12-09_20:34:57.267891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:58.727166 run osmo-stp_10.42.42.5(pid=12291): stderr: | 20221209203457439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203457439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203457440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203457440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203457441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203457441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203457441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:58.853397 run osmo-stp_10.42.42.5(pid=12291): stdout: | (launched: 2022-12-09_20:34:57.267891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:34:58.974510 run osmo-stp_10.42.42.5(pid=12291): stderr: | 20221209203457439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203457439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203457440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203457440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203457441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203457441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203457441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:34:59.120143 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12291): Process ended prematurely: osmo-stp_10.42.42.5(pid=12291) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:34:59.129360 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:34:59.155879 run osmo-hlr_10.42.42.2(pid=12288): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12288)] 20:34:59.203795 run osmo-hlr_10.42.42.2(pid=12288): stdout: | (launched: 2022-12-09_20:34:56.311230) 20:34:59.253259 run osmo-hlr_10.42.42.2(pid=12288): stderr: | 20221209203456488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203456488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203456488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203456489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203456489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203456489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203456500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203456509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203456510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203456510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:34:59.321943 run osmo-msc_10.42.42.6(pid=12294): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12294)] 20:34:59.369432 run osmo-msc_10.42.42.6(pid=12294): stdout: | (launched: 2022-12-09_20:34:58.242379) 20:34:59.418446 run osmo-msc_10.42.42.6(pid=12294): stderr: | 20221209203458514 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203458515 DLGLOBAL DEBUG validating counter group 0x7f4d59534c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203458515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203458515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203458515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203458515 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203458517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203458517 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203458518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203458518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:34:59.467951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Terminating (SIGTERM) 20:34:59.507299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Terminating (SIGTERM) 20:34:59.546624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12293): Terminating (SIGTERM) 20:34:59.586224 --- ParallelTerminationStrategy: PID 12287 died... 20:34:59.604999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Terminated: ok {rc=0} 20:34:59.649033 --- ParallelTerminationStrategy: PID 12290 died... 20:34:59.667236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Terminated: ok {rc=0} 20:34:59.711185 --- ParallelTerminationStrategy: PID 12293 died... 20:34:59.729522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12293): Terminated: ok {rc=0} 20:34:59.812181 bus /sierra_3: Setting Powered False 20:35:00.917271 bus /sierra_3: Setting Powered False 20:35:02.038141 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:35:03.198159 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.210660 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:35:03.283322 tst mo_mt_call_osmux.py: using LAC 23558 20:35:03.412683 tst mo_mt_call_osmux.py: using RAC 98 20:35:03.541456 tst mo_mt_call_osmux.py: using CellId 23558 20:35:03.668045 tst mo_mt_call_osmux.py: using BVCI 23559 20:35:03.785875 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.797600 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.809091 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.820576 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.832196 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:35:03.843685 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:35:03.959761 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:35:04.076507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:04.550332 run create_hlr_db(pid=12299): Launched 20:35:04.668391 bus /sierra_2: Setting Powered False 20:35:05.729207 run create_hlr_db(pid=12299): Terminated: ok {rc=0} 20:35:06.176259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Launched 20:35:06.502138 run osmo-hlr_10.42.42.2(pid=12302): Launched 20:35:06.628751 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:07.195878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Launched 20:35:07.521697 run osmo-stp_10.42.42.5(pid=12305): Launched 20:35:07.647317 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:08.238263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12307): Launched 20:35:08.565884 run osmo-msc_10.42.42.6(pid=12308): Launched 20:35:08.747654 run osmo-stp_10.42.42.5(pid=12305): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] 20:35:08.886038 run osmo-stp_10.42.42.5(pid=12305): stdout: | (launched: 2022-12-09_20:35:07.462063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:09.023429 run osmo-stp_10.42.42.5(pid=12305): stderr: | 20221209203507657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203507657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203507657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203507658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203507658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203507658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203507658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:09.160356 run osmo-stp_10.42.42.5(pid=12305): stdout: | (launched: 2022-12-09_20:35:07.462063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:09.291055 run osmo-stp_10.42.42.5(pid=12305): stderr: | 20221209203507657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203507657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203507657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203507658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203507658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203507658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203507658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:09.446562 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12305): Process ended prematurely: osmo-stp_10.42.42.5(pid=12305) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:35:09.456712 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:35:09.484503 run osmo-hlr_10.42.42.2(pid=12302): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12302)] 20:35:09.534454 run osmo-hlr_10.42.42.2(pid=12302): stdout: | (launched: 2022-12-09_20:35:06.442650) 20:35:09.585891 run osmo-hlr_10.42.42.2(pid=12302): stderr: | 20221209203506642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203506642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203506642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203506642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203506642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203506642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203506655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203506666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203506666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203506666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:09.657718 run osmo-msc_10.42.42.6(pid=12308): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12308)] 20:35:09.707232 run osmo-msc_10.42.42.6(pid=12308): stdout: | (launched: 2022-12-09_20:35:08.506053) 20:35:09.758295 run osmo-msc_10.42.42.6(pid=12308): stderr: | 20221209203508828 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203508828 DLGLOBAL DEBUG validating counter group 0x7f52457e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203508828 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203508828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203508828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203508828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203508830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203508831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203508831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203508831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:09.809870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminating (SIGTERM) 20:35:09.851111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Terminating (SIGTERM) 20:35:09.892327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12307): Terminating (SIGTERM) 20:35:09.934004 --- ParallelTerminationStrategy: PID 12301 died... 20:35:09.953419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12301): Terminated: ok {rc=0} 20:35:09.999752 --- ParallelTerminationStrategy: PID 12304 died... 20:35:10.019342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12304): Terminated: ok {rc=0} 20:35:10.065355 --- ParallelTerminationStrategy: PID 12307 died... 20:35:10.084827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12307): Terminated: ok {rc=0} 20:35:10.172529 bus /sierra_3: Setting Powered False 20:35:11.271786 bus /sierra_3: Setting Powered False 20:35:12.388537 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:35:13.639430 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:35:13.645227 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:35:13.679246 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:35:13.705625 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:35:13.757684 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:35:13.791635 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:35:13.818153 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:35:14.367331 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:35:14.416624 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:14.427665 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:35:14.497643 tst mo_mt_call.py: using LAC 23559 20:35:14.628653 tst mo_mt_call.py: using RAC 99 20:35:14.756440 tst mo_mt_call.py: using CellId 23559 20:35:14.884166 tst mo_mt_call.py: using BVCI 23560 20:35:15.002873 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:15.014557 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:15.026137 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:15.037547 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:15.048875 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:15.060209 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:15.177463 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:15.298370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:15.771220 run create_hlr_db(pid=12313): Launched 20:35:15.896123 bus /sierra_2: Setting Powered False 20:35:16.968717 run create_hlr_db(pid=12313): Terminated: ok {rc=0} 20:35:17.487575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Launched 20:35:17.814704 run osmo-hlr_10.42.42.2(pid=12316): Launched 20:35:17.941856 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:18.507584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Launched 20:35:18.834375 run osmo-stp_10.42.42.5(pid=12319): Launched 20:35:18.960724 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:19.556413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Launched 20:35:19.886326 run osmo-msc_10.42.42.6(pid=12322): Launched 20:35:20.070428 run osmo-stp_10.42.42.5(pid=12319): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] 20:35:20.208435 run osmo-stp_10.42.42.5(pid=12319): stdout: | (launched: 2022-12-09_20:35:18.774817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:20.347791 run osmo-stp_10.42.42.5(pid=12319): stderr: | 20221209203518969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203518969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203518970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203518970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203518970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203518970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203518970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:20.485340 run osmo-stp_10.42.42.5(pid=12319): stdout: | (launched: 2022-12-09_20:35:18.774817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:20.616317 run osmo-stp_10.42.42.5(pid=12319): stderr: | 20221209203518969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203518969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203518970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203518970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203518970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203518970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203518970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:20.773342 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12319): Process ended prematurely: osmo-stp_10.42.42.5(pid=12319) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:35:20.783198 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:35:20.811253 run osmo-hlr_10.42.42.2(pid=12316): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12316)] 20:35:20.861858 run osmo-hlr_10.42.42.2(pid=12316): stdout: | (launched: 2022-12-09_20:35:17.755276) 20:35:20.914276 run osmo-hlr_10.42.42.2(pid=12316): stderr: | 20221209203517954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203517954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203517954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203517954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203517954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203517954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203517966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203517975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203517975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203517975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:20.987206 run osmo-msc_10.42.42.6(pid=12322): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12322)] 20:35:21.037835 run osmo-msc_10.42.42.6(pid=12322): stdout: | (launched: 2022-12-09_20:35:19.826132) 20:35:21.089877 run osmo-msc_10.42.42.6(pid=12322): stderr: | 20221209203520151 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203520151 DLGLOBAL DEBUG validating counter group 0x7f768e503c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203520151 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203520152 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203520152 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203520152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203520154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203520154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203520154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203520154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:21.142684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Terminating (SIGTERM) 20:35:21.184935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Terminating (SIGTERM) 20:35:21.227334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Terminating (SIGTERM) 20:35:21.269575 --- ParallelTerminationStrategy: PID 12315 died... 20:35:21.289760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12315): Terminated: ok {rc=0} 20:35:21.336852 --- ParallelTerminationStrategy: PID 12318 died... 20:35:21.356835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12318): Terminated: ok {rc=0} 20:35:21.403373 --- ParallelTerminationStrategy: PID 12321 died... 20:35:21.423138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12321): Terminated: ok {rc=0} 20:35:21.511094 bus /sierra_3: Setting Powered False 20:35:22.610899 bus /sierra_3: Setting Powered False 20:35:23.727796 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:35:24.874788 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:24.886444 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:35:24.959831 tst mo_mt_call_osmux.py: using LAC 23560 20:35:25.078369 tst mo_mt_call_osmux.py: using RAC 100 20:35:25.196305 tst mo_mt_call_osmux.py: using CellId 23560 20:35:25.314917 tst mo_mt_call_osmux.py: using BVCI 23561 20:35:25.425960 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:25.436809 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:25.447656 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:25.458665 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:25.469789 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:35:25.480675 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:25.596622 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:35:25.720320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:26.226556 run create_hlr_db(pid=12324): Launched 20:35:26.347496 bus /sierra_2: Setting Powered False 20:35:27.408237 run create_hlr_db(pid=12324): Terminated: ok {rc=0} 20:35:27.854519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Launched 20:35:28.181755 run osmo-hlr_10.42.42.2(pid=12327): Launched 20:35:28.306183 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:28.867642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Launched 20:35:29.194461 run osmo-stp_10.42.42.5(pid=12330): Launched 20:35:29.319739 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:29.911449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Launched 20:35:30.239037 run osmo-msc_10.42.42.6(pid=12333): Launched 20:35:30.421321 run osmo-stp_10.42.42.5(pid=12330): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] 20:35:30.560128 run osmo-stp_10.42.42.5(pid=12330): stdout: | (launched: 2022-12-09_20:35:29.134061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:30.697856 run osmo-stp_10.42.42.5(pid=12330): stderr: | 20221209203529329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203529330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203529330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203529330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203529331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203529331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203529331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:30.835276 run osmo-stp_10.42.42.5(pid=12330): stdout: | (launched: 2022-12-09_20:35:29.134061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:30.971491 run osmo-stp_10.42.42.5(pid=12330): stderr: | 20221209203529329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203529330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203529330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203529330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203529331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203529331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203529331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:31.133820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12330): Process ended prematurely: osmo-stp_10.42.42.5(pid=12330) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:35:31.144620 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:35:31.173730 run osmo-hlr_10.42.42.2(pid=12327): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12327)] 20:35:31.225691 run osmo-hlr_10.42.42.2(pid=12327): stdout: | (launched: 2022-12-09_20:35:28.122012) 20:35:31.278904 run osmo-hlr_10.42.42.2(pid=12327): stderr: | 20221209203528323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203528323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203528323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203528324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203528324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203528324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203528335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203528344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203528344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203528344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:31.353595 run osmo-msc_10.42.42.6(pid=12333): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12333)] 20:35:31.405623 run osmo-msc_10.42.42.6(pid=12333): stdout: | (launched: 2022-12-09_20:35:30.179093) 20:35:31.459326 run osmo-msc_10.42.42.6(pid=12333): stderr: | 20221209203530502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203530502 DLGLOBAL DEBUG validating counter group 0x7f8e835cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203530502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203530502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203530502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203530502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203530504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203530505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203530505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203530505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:31.513647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Terminating (SIGTERM) 20:35:31.556902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Terminating (SIGTERM) 20:35:31.600063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Terminating (SIGTERM) 20:35:31.643053 --- ParallelTerminationStrategy: PID 12326 died... 20:35:31.663250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12326): Terminated: ok {rc=0} 20:35:31.710741 --- ParallelTerminationStrategy: PID 12329 died... 20:35:31.731036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12329): Terminated: ok {rc=0} 20:35:31.778632 --- ParallelTerminationStrategy: PID 12332 died... 20:35:31.799075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12332): Terminated: ok {rc=0} 20:35:31.890038 bus /sierra_3: Setting Powered False 20:35:32.991539 bus /sierra_3: Setting Powered False 20:35:34.108768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 20:35:35.367171 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:35:35.371953 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:35:35.406347 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:35:35.433552 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 20:35:35.519425 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:35:35.554002 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:35:35.581299 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 20:35:36.171246 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 20:35:36.176625 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.187953 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:35:36.241542 tst emergency_mo_mt_call.py: using LAC 23561 20:35:36.360003 tst emergency_mo_mt_call.py: using RAC 101 20:35:36.484656 tst emergency_mo_mt_call.py: using CellId 23561 20:35:36.607854 tst emergency_mo_mt_call.py: using BVCI 23562 20:35:36.718010 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.729104 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.739676 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.750540 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.761599 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:36.772395 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:36.886261 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:37.006336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:37.505135 run create_hlr_db(pid=12338): Launched 20:35:37.634326 bus /sierra_2: Setting Powered False 20:35:38.697937 run create_hlr_db(pid=12338): Terminated: ok {rc=0} 20:35:39.126060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12340): Launched 20:35:39.426134 run osmo-hlr_10.42.42.2(pid=12341): Launched 20:35:39.540186 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:40.067822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12343): Launched 20:35:40.365976 run osmo-stp_10.42.42.5(pid=12344): Launched 20:35:40.489903 tst emergency_mo_mt_call.py: using MSISDN 7368 20:35:40.642060 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:41.179856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12346): Launched 20:35:41.478901 run osmo-msc_10.42.42.6(pid=12347): Launched 20:35:41.646612 run osmo-stp_10.42.42.5(pid=12344): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12344)] 20:35:41.773728 run osmo-stp_10.42.42.5(pid=12344): stdout: | (launched: 2022-12-09_20:35:40.310920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:41.901116 run osmo-stp_10.42.42.5(pid=12344): stderr: | 20221209203540483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203540483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203540484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203540484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203540485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203540485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203540485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:42.025621 run osmo-stp_10.42.42.5(pid=12344): stdout: | (launched: 2022-12-09_20:35:40.310920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:42.144476 run osmo-stp_10.42.42.5(pid=12344): stderr: | 20221209203540483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203540483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203540484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203540484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203540485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203540485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203540485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:42.287094 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12344): Process ended prematurely: osmo-stp_10.42.42.5(pid=12344) [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12344)] [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 20:35:42.295625 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 20:35:42.321806 run osmo-hlr_10.42.42.2(pid=12341): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12341)] 20:35:42.369251 run osmo-hlr_10.42.42.2(pid=12341): stdout: | (launched: 2022-12-09_20:35:39.371084) 20:35:42.418562 run osmo-hlr_10.42.42.2(pid=12341): stderr: | 20221209203539549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203539549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203539549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203539549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203539549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203539549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203539562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203539571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203539571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203539571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:42.486685 run osmo-msc_10.42.42.6(pid=12347): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12347)] 20:35:42.533917 run osmo-msc_10.42.42.6(pid=12347): stdout: | (launched: 2022-12-09_20:35:41.423067) 20:35:42.582931 run osmo-msc_10.42.42.6(pid=12347): stderr: | 20221209203541696 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203541696 DLGLOBAL DEBUG validating counter group 0x7fd624a3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203541696 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203541697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203541697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203541697 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203541699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203541699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203541699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203541700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:42.632135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12340): Terminating (SIGTERM) 20:35:42.672286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12343): Terminating (SIGTERM) 20:35:42.711799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12346): Terminating (SIGTERM) 20:35:42.751494 --- ParallelTerminationStrategy: PID 12340 died... 20:35:42.770393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12340): Terminated: ok {rc=0} 20:35:42.814322 --- ParallelTerminationStrategy: PID 12343 died... 20:35:42.832573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12343): Terminated: ok {rc=0} 20:35:42.876247 --- ParallelTerminationStrategy: PID 12346 died... 20:35:42.894584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12346): Terminated: ok {rc=0} 20:35:42.977620 bus /sierra_3: Setting Powered False 20:35:44.074706 bus /sierra_3: Setting Powered False 20:35:45.192169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 20:35:46.277658 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.290008 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:35:46.344250 tst emergency_preemptive_call.py: using LAC 23562 20:35:46.477295 tst emergency_preemptive_call.py: using RAC 102 20:35:46.632375 tst emergency_preemptive_call.py: using CellId 23562 20:35:46.793072 tst emergency_preemptive_call.py: using BVCI 23563 20:35:46.904038 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.915871 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.927566 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.940091 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.952651 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:35:46.965532 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:47.084009 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:47.204091 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:47.323805 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:35:47.440319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:35:47.940886 run create_hlr_db(pid=12349): Launched 20:35:48.073204 bus /sierra_2: Setting Powered False 20:35:49.137034 run create_hlr_db(pid=12349): Terminated: ok {rc=0} 20:35:49.567855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12351): Launched 20:35:49.867696 run osmo-hlr_10.42.42.2(pid=12352): Launched 20:35:49.981828 run osmo-stp_10.42.42.5: Starting osmo-stp 20:35:50.497719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12354): Launched 20:35:50.797193 run osmo-stp_10.42.42.5(pid=12355): Launched 20:35:50.921747 tst emergency_preemptive_call.py: using MSISDN 7369 20:35:51.074978 run osmo-msc_10.42.42.6: Starting osmo-msc 20:35:51.611994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12357): Launched 20:35:51.910589 run osmo-msc_10.42.42.6(pid=12358): Launched 20:35:52.078202 run osmo-stp_10.42.42.5(pid=12355): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12355)] 20:35:52.205367 run osmo-stp_10.42.42.5(pid=12355): stdout: | (launched: 2022-12-09_20:35:50.742092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:52.332753 run osmo-stp_10.42.42.5(pid=12355): stderr: | 20221209203550912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203550912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203550913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203550913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203550913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203550914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203550915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:52.457894 run osmo-stp_10.42.42.5(pid=12355): stdout: | (launched: 2022-12-09_20:35:50.742092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:35:52.577245 run osmo-stp_10.42.42.5(pid=12355): stderr: | 20221209203550912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203550912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203550913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203550913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203550913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203550914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203550915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:35:52.719571 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12355): Process ended prematurely: osmo-stp_10.42.42.5(pid=12355) [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12355)] [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 20:35:52.728113 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 20:35:52.754345 run osmo-hlr_10.42.42.2(pid=12352): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12352)] 20:35:52.802589 run osmo-hlr_10.42.42.2(pid=12352): stdout: | (launched: 2022-12-09_20:35:49.812327) 20:35:52.852077 run osmo-hlr_10.42.42.2(pid=12352): stderr: | 20221209203549987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203549987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203549987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203549987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203549987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203549987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203549999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203550007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203550008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203550008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:35:52.921163 run osmo-msc_10.42.42.6(pid=12358): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12358)] 20:35:52.968722 run osmo-msc_10.42.42.6(pid=12358): stdout: | (launched: 2022-12-09_20:35:51.855251) 20:35:53.018236 run osmo-msc_10.42.42.6(pid=12358): stderr: | 20221209203552127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209203552127 DLGLOBAL DEBUG validating counter group 0x7f4ef729cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209203552127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209203552127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209203552128 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209203552128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209203552130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209203552130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209203552131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209203552131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:35:53.068091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12351): Terminating (SIGTERM) 20:35:53.107731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12354): Terminating (SIGTERM) 20:35:53.147167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12357): Terminating (SIGTERM) 20:35:53.186957 --- ParallelTerminationStrategy: PID 12351 died... 20:35:53.205812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12351): Terminated: ok {rc=0} 20:35:53.249692 --- ParallelTerminationStrategy: PID 12354 died... 20:35:53.268058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12354): Terminated: ok {rc=0} 20:35:53.312476 --- ParallelTerminationStrategy: PID 12357 died... 20:35:53.330808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12357): Terminated: ok {rc=0} 20:35:53.413616 bus /sierra_9: Setting Powered False 20:35:54.508913 bus /sierra_9: Setting Powered False 20:35:55.621960 bus /sierra_8: Setting Powered False 20:35:56.717149 bus /sierra_8: Setting Powered False 20:35:57.828704 bus /sierra_3: Setting Powered False 20:35:58.925936 bus /sierra_3: Setting Powered False 20:36:00.040848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 20:36:01.369923 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:36:01.376773 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 20:36:01.421631 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 20:36:01.470486 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 20:36:01.577834 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 20:36:01.617793 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 20:36:01.659283 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 20:36:02.253813 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 20:36:02.309092 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.320415 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:02.371995 tst cs_paging_gprs_active.py: using LAC 23563 20:36:02.502593 tst cs_paging_gprs_active.py: using RAC 103 20:36:02.632720 tst cs_paging_gprs_active.py: using CellId 23563 20:36:02.763075 tst cs_paging_gprs_active.py: using BVCI 23564 20:36:02.883719 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.894971 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.906201 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.918016 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.929411 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.940729 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.952352 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.963728 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:02.975589 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:03.095634 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:03.210756 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:36:03.417425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:03.724684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12363): Launched 20:36:03.991254 run iperf3-srv_10.42.42.10(pid=12364): Launched 20:36:04.105594 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:36:04.310789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:04.618450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Launched 20:36:04.886243 run iperf3-srv_10.42.42.10(pid=12366): Launched 20:36:05.003036 tst cs_paging_gprs_active.py:38: start network... 20:36:05.208535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:05.684197 run create_hlr_db(pid=12367): Launched 20:36:05.802148 bus /sierra_2: Setting Powered False 20:36:06.863238 run create_hlr_db(pid=12367): Terminated: ok {rc=0} 20:36:07.311248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Launched 20:36:07.641795 run osmo-hlr_10.42.42.2(pid=12370): Launched 20:36:07.769826 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:08.337359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Launched 20:36:08.665994 run osmo-stp_10.42.42.5(pid=12373): Launched 20:36:08.791839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:09.358404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12375): Launched 20:36:09.484545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:09.763052 run patchelf(pid=12376): Launched 20:36:09.946870 run osmo-stp_10.42.42.5(pid=12373): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] 20:36:10.086118 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-09_20:36:08.605976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:10.227216 run osmo-stp_10.42.42.5(pid=12373): stderr: | 20221209203608797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203608797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203608798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203608798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203608798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203608798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203608799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:10.367842 run osmo-stp_10.42.42.5(pid=12373): stdout: | (launched: 2022-12-09_20:36:08.605976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:10.502581 run osmo-stp_10.42.42.5(pid=12373): stderr: | 20221209203608797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203608797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203608798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203608798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203608798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203608798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203608799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:10.662378 run patchelf(pid=12376): Terminating (SIGINT) 20:36:10.846764 run patchelf(pid=12376): Terminated: ok {rc=0} 20:36:10.979731 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2364↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] [trial-2364↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 20:36:10.990260 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:36:11.018961 run osmo-hlr_10.42.42.2(pid=12370): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12370)] 20:36:11.068797 run osmo-hlr_10.42.42.2(pid=12370): stdout: | (launched: 2022-12-09_20:36:07.582042) 20:36:11.120242 run osmo-hlr_10.42.42.2(pid=12370): stderr: | 20221209203607782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203607782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203607782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203607782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203607782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203607782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203607796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203607804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203607804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203607804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:11.172453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12363): Terminating (SIGTERM) 20:36:11.214378 run iperf3-srv_10.42.42.10(pid=12364): Terminating (SIGTERM) 20:36:11.255932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Terminating (SIGTERM) 20:36:11.297677 run iperf3-srv_10.42.42.10(pid=12366): Terminating (SIGTERM) 20:36:11.339286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminating (SIGTERM) 20:36:11.381080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminating (SIGTERM) 20:36:11.422785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12375): Terminating (SIGTERM) 20:36:11.465071 --- ParallelTerminationStrategy: PID 12363 died... 20:36:11.485048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12363): Terminated: ok {rc=0} 20:36:11.531280 --- ParallelTerminationStrategy: PID 12364 died... 20:36:11.550861 run iperf3-srv_10.42.42.10(pid=12364): Terminated {rc=256} 20:36:11.596918 --- ParallelTerminationStrategy: PID 12365 died... 20:36:11.616519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12365): Terminated: ok {rc=0} 20:36:11.662375 --- ParallelTerminationStrategy: PID 12366 died... 20:36:11.681851 run iperf3-srv_10.42.42.10(pid=12366): Terminated {rc=256} 20:36:11.728082 --- ParallelTerminationStrategy: PID 12369 died... 20:36:11.747978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12369): Terminated: ok {rc=0} 20:36:11.794030 --- ParallelTerminationStrategy: PID 12372 died... 20:36:11.813711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12372): Terminated: ok {rc=0} 20:36:11.860199 --- ParallelTerminationStrategy: PID 12375 died... 20:36:11.880157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12375): Terminated: ok {rc=0} 20:36:11.969774 bus /gobi_0: Setting Powered False 20:36:13.069947 bus /gobi_0: Setting Powered False 20:36:14.186054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 20:36:15.337280 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.349338 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:15.403671 tst iperf3.py: using LAC 23564 20:36:15.533481 tst iperf3.py: using RAC 104 20:36:15.661366 tst iperf3.py: using CellId 23564 20:36:15.792219 tst iperf3.py: using BVCI 23565 20:36:15.918815 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.930609 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.942398 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.954101 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.965983 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.977689 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:15.989683 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:16.001460 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:16.013385 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:16.133092 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:36:16.347872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:16.668839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12377): Launched 20:36:16.956220 run iperf3-srv_10.42.42.10(pid=12378): Launched 20:36:17.089668 tst iperf3.py:8: start network... 20:36:17.302339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:17.780464 run create_hlr_db(pid=12379): Launched 20:36:17.899555 bus /gobi_6: Setting Powered False 20:36:18.960155 run create_hlr_db(pid=12379): Terminated: ok {rc=0} 20:36:19.410326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Launched 20:36:19.741719 run osmo-hlr_10.42.42.2(pid=12382): Launched 20:36:19.869153 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:20.439110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Launched 20:36:20.770239 run osmo-stp_10.42.42.5(pid=12385): Launched 20:36:20.897201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:21.466899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12387): Launched 20:36:21.593835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:21.873270 run patchelf(pid=12388): Launched 20:36:22.076328 run osmo-stp_10.42.42.5(pid=12385): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] 20:36:22.207068 run osmo-stp_10.42.42.5(pid=12385): stdout: | (launched: 2022-12-09_20:36:20.710077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:22.339113 run osmo-stp_10.42.42.5(pid=12385): stderr: | 20221209203620902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203620902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203620903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203620903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203620903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203620903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203620904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:22.471070 run osmo-stp_10.42.42.5(pid=12385): stdout: | (launched: 2022-12-09_20:36:20.710077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:22.598109 run osmo-stp_10.42.42.5(pid=12385): stderr: | 20221209203620902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203620902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203620903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203620903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203620903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203620903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203620904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:22.748575 run patchelf(pid=12388): Terminating (SIGINT) 20:36:22.921701 run patchelf(pid=12388): Terminated: ok {rc=0} 20:36:23.046949 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12385): Process ended prematurely: osmo-stp_10.42.42.5(pid=12385) [trial-2364↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] [trial-2364↪gprs:trx-sysmocell5000↪iperf3.py:8] 20:36:23.056650 tst iperf3.py:8: Test FAILED (7.8 sec) 20:36:23.084695 run osmo-hlr_10.42.42.2(pid=12382): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12382)] 20:36:23.133172 run osmo-hlr_10.42.42.2(pid=12382): stdout: | (launched: 2022-12-09_20:36:19.681512) 20:36:23.183350 run osmo-hlr_10.42.42.2(pid=12382): stderr: | 20221209203619881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203619881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203619881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203619881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203619881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203619881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203619894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203619903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203619903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203619903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:23.234358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12377): Terminating (SIGTERM) 20:36:23.274784 run iperf3-srv_10.42.42.10(pid=12378): Terminating (SIGTERM) 20:36:23.315030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Terminating (SIGTERM) 20:36:23.355523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Terminating (SIGTERM) 20:36:23.395948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12387): Terminating (SIGTERM) 20:36:23.436753 --- ParallelTerminationStrategy: PID 12377 died... 20:36:23.456268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12377): Terminated: ok {rc=0} 20:36:23.501728 --- ParallelTerminationStrategy: PID 12378 died... 20:36:23.520605 run iperf3-srv_10.42.42.10(pid=12378): Terminated {rc=256} 20:36:23.565459 --- ParallelTerminationStrategy: PID 12381 died... 20:36:23.584467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12381): Terminated: ok {rc=0} 20:36:23.629471 --- ParallelTerminationStrategy: PID 12384 died... 20:36:23.648504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12384): Terminated: ok {rc=0} 20:36:23.693542 --- ParallelTerminationStrategy: PID 12387 died... 20:36:23.712581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12387): Terminated: ok {rc=0} 20:36:23.800289 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 20:36:24.949909 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:24.961384 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:25.010713 tst iperf3m4.py: using LAC 23565 20:36:25.130594 tst iperf3m4.py: using RAC 105 20:36:25.253132 tst iperf3m4.py: using CellId 23565 20:36:25.375227 tst iperf3m4.py: using BVCI 23566 20:36:25.486475 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.497326 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.508006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.518896 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.529605 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.540230 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.551113 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.561849 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:25.572684 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:25.694414 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:25.815490 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:25.936648 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:26.056436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:36:26.279727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:26.609874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12389): Launched 20:36:26.894744 run iperf3-srv_10.42.42.10(pid=12390): Launched 20:36:27.019124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:36:27.241768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:27.572094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12391): Launched 20:36:27.857781 run iperf3-srv_10.42.42.10(pid=12392): Launched 20:36:27.981526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:36:28.204074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:28.534753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12393): Launched 20:36:28.821722 run iperf3-srv_10.42.42.10(pid=12394): Launched 20:36:28.943965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:36:29.165727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:36:29.497086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12395): Launched 20:36:29.782580 run iperf3-srv_10.42.42.10(pid=12396): Launched 20:36:29.907304 tst iperf3m4.py:8: start network... 20:36:30.128704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:30.639151 run create_hlr_db(pid=12397): Launched 20:36:30.773088 bus /gobi_6: Setting Powered False 20:36:31.857880 run create_hlr_db(pid=12397): Terminated: ok {rc=0} 20:36:32.341320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12399): Launched 20:36:32.671094 run osmo-hlr_10.42.42.2(pid=12400): Launched 20:36:32.795474 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:33.362689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12402): Launched 20:36:33.690983 run osmo-stp_10.42.42.5(pid=12403): Launched 20:36:33.817264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:34.384349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12405): Launched 20:36:34.509181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:34.786709 run patchelf(pid=12406): Launched 20:36:34.970999 run osmo-stp_10.42.42.5(pid=12403): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12403)] 20:36:35.109478 run osmo-stp_10.42.42.5(pid=12403): stdout: | (launched: 2022-12-09_20:36:33.630693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:35.250156 run osmo-stp_10.42.42.5(pid=12403): stderr: | 20221209203633819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203633819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203633819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203633819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203633820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203633820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203633820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:35.390618 run osmo-stp_10.42.42.5(pid=12403): stdout: | (launched: 2022-12-09_20:36:33.630693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:35.524873 run osmo-stp_10.42.42.5(pid=12403): stderr: | 20221209203633819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203633819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203633819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203633819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203633820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203633820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203633820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:35.684312 run patchelf(pid=12406): Terminating (SIGINT) 20:36:35.867653 run patchelf(pid=12406): Terminated: ok {rc=0} 20:36:36.000642 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12403): Process ended prematurely: osmo-stp_10.42.42.5(pid=12403) [trial-2364↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12403)] [trial-2364↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 20:36:36.011088 tst iperf3m4.py:8: Test FAILED (11.1 sec) 20:36:36.040039 run osmo-hlr_10.42.42.2(pid=12400): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12400)] 20:36:36.090543 run osmo-hlr_10.42.42.2(pid=12400): stdout: | (launched: 2022-12-09_20:36:32.610772) 20:36:36.142541 run osmo-hlr_10.42.42.2(pid=12400): stderr: | 20221209203632807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203632807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203632807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203632808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203632808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203632808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203632821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203632829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203632830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203632830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:36.195691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12389): Terminating (SIGTERM) 20:36:36.237688 run iperf3-srv_10.42.42.10(pid=12390): Terminating (SIGTERM) 20:36:36.279187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12391): Terminating (SIGTERM) 20:36:36.321224 run iperf3-srv_10.42.42.10(pid=12392): Terminating (SIGTERM) 20:36:36.363142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12393): Terminating (SIGTERM) 20:36:36.405356 run iperf3-srv_10.42.42.10(pid=12394): Terminating (SIGTERM) 20:36:36.447343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12395): Terminating (SIGTERM) 20:36:36.489355 run iperf3-srv_10.42.42.10(pid=12396): Terminating (SIGTERM) 20:36:36.531306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12399): Terminating (SIGTERM) 20:36:36.573040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12402): Terminating (SIGTERM) 20:36:36.615087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12405): Terminating (SIGTERM) 20:36:36.657673 --- ParallelTerminationStrategy: PID 12389 died... 20:36:36.678035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12389): Terminated: ok {rc=0} 20:36:36.724546 --- ParallelTerminationStrategy: PID 12390 died... 20:36:36.744240 run iperf3-srv_10.42.42.10(pid=12390): Terminated {rc=256} 20:36:36.790418 --- ParallelTerminationStrategy: PID 12391 died... 20:36:36.810177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12391): Terminated: ok {rc=0} 20:36:36.856593 --- ParallelTerminationStrategy: PID 12392 died... 20:36:36.876300 run iperf3-srv_10.42.42.10(pid=12392): Terminated {rc=256} 20:36:36.922574 --- ParallelTerminationStrategy: PID 12393 died... 20:36:36.942253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12393): Terminated: ok {rc=0} 20:36:36.988343 --- ParallelTerminationStrategy: PID 12394 died... 20:36:37.007973 run iperf3-srv_10.42.42.10(pid=12394): Terminated {rc=256} 20:36:37.054725 --- ParallelTerminationStrategy: PID 12395 died... 20:36:37.074511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12395): Terminated: ok {rc=0} 20:36:37.120743 --- ParallelTerminationStrategy: PID 12396 died... 20:36:37.140508 run iperf3-srv_10.42.42.10(pid=12396): Terminated {rc=256} 20:36:37.187069 --- ParallelTerminationStrategy: PID 12399 died... 20:36:37.206908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12399): Terminated: ok {rc=0} 20:36:37.253657 --- ParallelTerminationStrategy: PID 12402 died... 20:36:37.273464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12402): Terminated: ok {rc=0} 20:36:37.320047 --- ParallelTerminationStrategy: PID 12405 died... 20:36:37.339988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12405): Terminated: ok {rc=0} 20:36:37.427882 bus /gobi_4: Setting Powered False 20:36:38.528109 bus /gobi_4: Setting Powered False 20:36:39.646129 bus /gobi_1: Setting Powered False 20:36:40.745758 bus /gobi_1: Setting Powered False 20:36:41.861864 bus /gobi_0: Setting Powered False 20:36:42.961251 bus /gobi_0: Setting Powered False 20:36:44.083129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 20:36:45.187192 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.198827 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:45.249704 tst ping.py: using LAC 23566 20:36:45.379100 tst ping.py: using RAC 106 20:36:45.507063 tst ping.py: using CellId 23566 20:36:45.635916 tst ping.py: using BVCI 23567 20:36:45.754488 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.766015 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.777075 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.788065 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.799048 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.809972 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.821170 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:45.832257 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:45.975947 tst ping.py:19: start network... 20:36:46.182789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:46.663427 run create_hlr_db(pid=12408): Launched 20:36:46.824111 bus /gobi_6: Setting Powered False 20:36:47.887306 run create_hlr_db(pid=12408): Terminated: ok {rc=0} 20:36:48.335204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12410): Launched 20:36:48.656529 run osmo-hlr_10.42.42.2(pid=12411): Launched 20:36:48.778462 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:49.335258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12413): Launched 20:36:49.658278 run osmo-stp_10.42.42.5(pid=12414): Launched 20:36:49.780044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:50.337950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12416): Launched 20:36:50.460723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:50.732098 run patchelf(pid=12417): Launched 20:36:50.910926 run osmo-stp_10.42.42.5(pid=12414): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12414)] 20:36:51.047364 run osmo-stp_10.42.42.5(pid=12414): stdout: | (launched: 2022-12-09_20:36:49.599247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:51.186114 run osmo-stp_10.42.42.5(pid=12414): stderr: | 20221209203649791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203649791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203649792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203649792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203649792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203649793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203649793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:51.324204 run osmo-stp_10.42.42.5(pid=12414): stdout: | (launched: 2022-12-09_20:36:49.599247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:51.456311 run osmo-stp_10.42.42.5(pid=12414): stderr: | 20221209203649791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203649791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203649792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203649792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203649792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203649793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203649793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:51.612884 run patchelf(pid=12417): Terminating (SIGINT) 20:36:51.792705 run patchelf(pid=12417): Terminated: ok {rc=0} 20:36:51.922760 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12414): Process ended prematurely: osmo-stp_10.42.42.5(pid=12414) [trial-2364↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12414)] [trial-2364↪gprs:trx-sysmocell5000↪ping.py:22] 20:36:51.932425 tst ping.py:22: Test FAILED (6.7 sec) 20:36:51.961000 run osmo-hlr_10.42.42.2(pid=12411): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12411)] 20:36:52.011407 run osmo-hlr_10.42.42.2(pid=12411): stdout: | (launched: 2022-12-09_20:36:48.597529) 20:36:52.064055 run osmo-hlr_10.42.42.2(pid=12411): stderr: | 20221209203648795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203648796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203648796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203648796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203648796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203648796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203648807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203648816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203648816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203648816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:36:52.117322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12410): Terminating (SIGTERM) 20:36:52.159732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12413): Terminating (SIGTERM) 20:36:52.202432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12416): Terminating (SIGTERM) 20:36:52.245227 --- ParallelTerminationStrategy: PID 12410 died... 20:36:52.265440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12410): Terminated: ok {rc=0} 20:36:52.312440 --- ParallelTerminationStrategy: PID 12413 died... 20:36:52.332378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12413): Terminated: ok {rc=0} 20:36:52.379180 --- ParallelTerminationStrategy: PID 12416 died... 20:36:52.399439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12416): Terminated: ok {rc=0} 20:36:52.487331 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 20:36:53.576495 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:53.588460 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 20:36:53.644086 tst ping_idle_ping.py: using LAC 23567 20:36:53.762023 tst ping_idle_ping.py: using RAC 107 20:36:53.880860 tst ping_idle_ping.py: using CellId 23567 20:36:53.997065 tst ping_idle_ping.py: using BVCI 23568 20:36:54.106499 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.117349 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.127935 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.138768 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.149541 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.160302 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.171233 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 20:36:54.182081 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 20:36:54.301207 tst ping_idle_ping.py:24: start network... 20:36:54.518285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:36:55.020149 run create_hlr_db(pid=12418): Launched 20:36:55.151838 bus /gobi_6: Setting Powered False 20:36:56.216515 run create_hlr_db(pid=12418): Terminated: ok {rc=0} 20:36:56.648865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Launched 20:36:56.951815 run osmo-hlr_10.42.42.2(pid=12421): Launched 20:36:57.066778 run osmo-stp_10.42.42.5: Starting osmo-stp 20:36:57.585661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Launched 20:36:57.887356 run osmo-stp_10.42.42.5(pid=12424): Launched 20:36:58.001941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:36:58.523068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Launched 20:36:58.637702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:36:58.892145 run patchelf(pid=12427): Launched 20:36:59.059228 run osmo-stp_10.42.42.5(pid=12424): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] 20:36:59.186754 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-09_20:36:57.831873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:59.316227 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221209203658001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203658001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203658002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203658002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203658002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203658003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203658003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:59.445967 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-09_20:36:57.831873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:36:59.569827 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221209203658001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203658001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203658002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203658002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203658002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203658003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203658003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:36:59.716409 run patchelf(pid=12427): Terminating (SIGINT) 20:36:59.885952 run patchelf(pid=12427): Terminated: ok {rc=0} 20:37:00.007776 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2364↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] [trial-2364↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 20:37:00.016847 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:37:00.044240 run osmo-hlr_10.42.42.2(pid=12421): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12421)] 20:37:00.093118 run osmo-hlr_10.42.42.2(pid=12421): stdout: | (launched: 2022-12-09_20:36:56.895818) 20:37:00.143361 run osmo-hlr_10.42.42.2(pid=12421): stderr: | 20221209203657073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203657073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203657073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203657073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203657073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203657073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203657086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203657095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203657095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203657095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:00.193944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminating (SIGTERM) 20:37:00.234010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminating (SIGTERM) 20:37:00.273630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminating (SIGTERM) 20:37:00.314607 --- ParallelTerminationStrategy: PID 12420 died... 20:37:00.333684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminated: ok {rc=0} 20:37:00.378006 --- ParallelTerminationStrategy: PID 12423 died... 20:37:00.396660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminated: ok {rc=0} 20:37:00.441343 --- ParallelTerminationStrategy: PID 12426 died... 20:37:00.460264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminated: ok {rc=0} 20:37:00.544425 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 20:37:01.905162 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:37:01.913388 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:37:01.953757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:37:02.001529 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:37:02.105800 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:37:02.159527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:37:02.215759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:37:02.770933 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:37:02.820512 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:02.831643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:02.882039 tst cs_paging_gprs_active.py: using LAC 23568 20:37:03.002737 tst cs_paging_gprs_active.py: using RAC 108 20:37:03.124513 tst cs_paging_gprs_active.py: using CellId 23568 20:37:03.245388 tst cs_paging_gprs_active.py: using BVCI 23569 20:37:03.356570 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.367539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.378313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.389294 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.400051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.411011 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.422233 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.433354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:03.444354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:03.567023 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:03.690593 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:37:03.913673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:04.245701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12431): Launched 20:37:04.532752 run iperf3-srv_10.42.42.10(pid=12432): Launched 20:37:04.655905 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:37:04.878541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:05.210723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12433): Launched 20:37:05.497308 run iperf3-srv_10.42.42.10(pid=12434): Launched 20:37:05.619974 tst cs_paging_gprs_active.py:38: start network... 20:37:05.842140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:06.353212 run create_hlr_db(pid=12435): Launched 20:37:06.486021 bus /gobi_6: Setting Powered False 20:37:07.549828 run create_hlr_db(pid=12435): Terminated: ok {rc=0} 20:37:07.988131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Launched 20:37:08.319448 run osmo-hlr_10.42.42.2(pid=12438): Launched 20:37:08.444077 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:09.009208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Launched 20:37:09.337983 run osmo-stp_10.42.42.5(pid=12441): Launched 20:37:09.463893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:10.030487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Launched 20:37:10.155751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:10.435132 run patchelf(pid=12444): Launched 20:37:10.619022 run osmo-stp_10.42.42.5(pid=12441): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] 20:37:10.757845 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-09_20:37:09.277801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:10.897956 run osmo-stp_10.42.42.5(pid=12441): stderr: | 20221209203709470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203709470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203709470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203709471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203709471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203709471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203709471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:11.038061 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-09_20:37:09.277801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:11.172523 run osmo-stp_10.42.42.5(pid=12441): stderr: | 20221209203709470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203709470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203709470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203709471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203709471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203709471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203709471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:11.332500 run patchelf(pid=12444): Terminating (SIGINT) 20:37:11.516321 run patchelf(pid=12444): Terminated: ok {rc=0} 20:37:11.648885 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:37:11.659348 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:37:11.687827 run osmo-hlr_10.42.42.2(pid=12438): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12438)] 20:37:11.737520 run osmo-hlr_10.42.42.2(pid=12438): stdout: | (launched: 2022-12-09_20:37:08.259452) 20:37:11.789282 run osmo-hlr_10.42.42.2(pid=12438): stderr: | 20221209203708460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203708460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203708460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203708460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203708460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203708460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203708472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203708480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203708481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203708481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:11.841320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12431): Terminating (SIGTERM) 20:37:11.883135 run iperf3-srv_10.42.42.10(pid=12432): Terminating (SIGTERM) 20:37:11.924399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12433): Terminating (SIGTERM) 20:37:11.965970 run iperf3-srv_10.42.42.10(pid=12434): Terminating (SIGTERM) 20:37:12.007124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminating (SIGTERM) 20:37:12.048503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminating (SIGTERM) 20:37:12.089891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Terminating (SIGTERM) 20:37:12.131564 --- ParallelTerminationStrategy: PID 12431 died... 20:37:12.151360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12431): Terminated: ok {rc=0} 20:37:12.197555 --- ParallelTerminationStrategy: PID 12432 died... 20:37:12.217245 run iperf3-srv_10.42.42.10(pid=12432): Terminated {rc=256} 20:37:12.263427 --- ParallelTerminationStrategy: PID 12433 died... 20:37:12.282850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12433): Terminated: ok {rc=0} 20:37:12.328770 --- ParallelTerminationStrategy: PID 12434 died... 20:37:12.348288 run iperf3-srv_10.42.42.10(pid=12434): Terminated {rc=256} 20:37:12.393998 --- ParallelTerminationStrategy: PID 12437 died... 20:37:12.413382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminated: ok {rc=0} 20:37:12.459271 --- ParallelTerminationStrategy: PID 12440 died... 20:37:12.478732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminated: ok {rc=0} 20:37:12.524449 --- ParallelTerminationStrategy: PID 12443 died... 20:37:12.543944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Terminated: ok {rc=0} 20:37:12.631135 bus /gobi_0: Setting Powered False 20:37:13.731299 bus /gobi_0: Setting Powered False 20:37:14.849269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:37:16.004756 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.017514 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:16.074265 tst iperf3.py: using LAC 23569 20:37:16.205051 tst iperf3.py: using RAC 109 20:37:16.332891 tst iperf3.py: using CellId 23569 20:37:16.455622 tst iperf3.py: using BVCI 23570 20:37:16.574097 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.586687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.598816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.611796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.624848 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.638854 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.652217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.664601 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:16.678688 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:16.801401 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:37:17.043361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:17.369176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12445): Launched 20:37:17.636153 run iperf3-srv_10.42.42.10(pid=12446): Launched 20:37:17.751562 tst iperf3.py:8: start network... 20:37:17.956785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:18.432111 run create_hlr_db(pid=12447): Launched 20:37:18.549757 bus /gobi_6: Setting Powered False 20:37:19.610396 run create_hlr_db(pid=12447): Terminated: ok {rc=0} 20:37:20.058749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Launched 20:37:20.388699 run osmo-hlr_10.42.42.2(pid=12450): Launched 20:37:20.514349 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:21.083793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Launched 20:37:21.411186 run osmo-stp_10.42.42.5(pid=12453): Launched 20:37:21.537505 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:22.103803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Launched 20:37:22.229023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:22.507376 run patchelf(pid=12456): Launched 20:37:22.689083 run osmo-stp_10.42.42.5(pid=12453): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] 20:37:22.826978 run osmo-stp_10.42.42.5(pid=12453): stdout: | (launched: 2022-12-09_20:37:21.351377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:22.967074 run osmo-stp_10.42.42.5(pid=12453): stderr: | 20221209203721545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203721545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203721545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203721546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203721546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203721546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203721546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:23.106725 run osmo-stp_10.42.42.5(pid=12453): stdout: | (launched: 2022-12-09_20:37:21.351377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:23.241728 run osmo-stp_10.42.42.5(pid=12453): stderr: | 20221209203721545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203721545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203721545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203721546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203721546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203721546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203721546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:23.400417 run patchelf(pid=12456): Terminating (SIGINT) 20:37:23.583148 run patchelf(pid=12456): Terminated: ok {rc=0} 20:37:23.714984 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12453): Process ended prematurely: osmo-stp_10.42.42.5(pid=12453) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 20:37:23.725451 tst iperf3.py:8: Test FAILED (7.8 sec) 20:37:23.753980 run osmo-hlr_10.42.42.2(pid=12450): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12450)] 20:37:23.803993 run osmo-hlr_10.42.42.2(pid=12450): stdout: | (launched: 2022-12-09_20:37:20.328805) 20:37:23.855690 run osmo-hlr_10.42.42.2(pid=12450): stderr: | 20221209203720530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203720530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203720530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203720530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203720530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203720530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203720543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203720553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203720553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203720553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:23.907793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12445): Terminating (SIGTERM) 20:37:23.949445 run iperf3-srv_10.42.42.10(pid=12446): Terminating (SIGTERM) 20:37:23.990912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Terminating (SIGTERM) 20:37:24.032597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Terminating (SIGTERM) 20:37:24.074369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Terminating (SIGTERM) 20:37:24.116093 --- ParallelTerminationStrategy: PID 12445 died... 20:37:24.135887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12445): Terminated: ok {rc=0} 20:37:24.182366 --- ParallelTerminationStrategy: PID 12446 died... 20:37:24.201994 run iperf3-srv_10.42.42.10(pid=12446): Terminated {rc=256} 20:37:24.247896 --- ParallelTerminationStrategy: PID 12449 died... 20:37:24.267342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12449): Terminated: ok {rc=0} 20:37:24.313674 --- ParallelTerminationStrategy: PID 12452 died... 20:37:24.333421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12452): Terminated: ok {rc=0} 20:37:24.379595 --- ParallelTerminationStrategy: PID 12455 died... 20:37:24.399167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12455): Terminated: ok {rc=0} 20:37:24.487124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:37:25.638794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:25.651031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:25.704125 tst iperf3m4.py: using LAC 23570 20:37:25.837198 tst iperf3m4.py: using RAC 110 20:37:25.965473 tst iperf3m4.py: using CellId 23570 20:37:26.097369 tst iperf3m4.py: using BVCI 23571 20:37:26.217414 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.228880 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.240123 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.251612 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.262966 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.274347 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.285899 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.297321 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:26.308779 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:26.427746 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:26.551178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:26.669687 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:26.786783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:37:26.993438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:27.300427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Launched 20:37:27.568017 run iperf3-srv_10.42.42.10(pid=12458): Launched 20:37:27.682851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:37:27.888657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:28.196613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Launched 20:37:28.463718 run iperf3-srv_10.42.42.10(pid=12460): Launched 20:37:28.578601 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:37:28.784826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:29.092327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Launched 20:37:29.359624 run iperf3-srv_10.42.42.10(pid=12462): Launched 20:37:29.474285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:37:29.679807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:37:29.987392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Launched 20:37:30.255530 run iperf3-srv_10.42.42.10(pid=12464): Launched 20:37:30.372234 tst iperf3m4.py:8: start network... 20:37:30.578150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:31.059874 run create_hlr_db(pid=12465): Launched 20:37:31.229324 bus /gobi_6: Setting Powered False 20:37:32.302782 run create_hlr_db(pid=12465): Terminated: ok {rc=0} 20:37:32.752382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Launched 20:37:33.081135 run osmo-hlr_10.42.42.2(pid=12468): Launched 20:37:33.206193 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:33.776478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Launched 20:37:34.106351 run osmo-stp_10.42.42.5(pid=12471): Launched 20:37:34.232447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:34.800532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Launched 20:37:34.927166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:35.204834 run patchelf(pid=12474): Launched 20:37:35.387691 run osmo-stp_10.42.42.5(pid=12471): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] 20:37:35.525992 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-09_20:37:34.046057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:35.666060 run osmo-stp_10.42.42.5(pid=12471): stderr: | 20221209203734235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203734235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203734235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203734236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203734236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203734236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203734236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:35.806215 run osmo-stp_10.42.42.5(pid=12471): stdout: | (launched: 2022-12-09_20:37:34.046057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:35.943861 run osmo-stp_10.42.42.5(pid=12471): stderr: | 20221209203734235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203734235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203734235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203734236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203734236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203734236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203734236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:36.103466 run patchelf(pid=12474): Terminating (SIGINT) 20:37:36.287980 run patchelf(pid=12474): Terminated: ok {rc=0} 20:37:36.421056 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 20:37:36.431689 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:37:36.461183 run osmo-hlr_10.42.42.2(pid=12468): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12468)] 20:37:36.511198 run osmo-hlr_10.42.42.2(pid=12468): stdout: | (launched: 2022-12-09_20:37:33.021048) 20:37:36.563310 run osmo-hlr_10.42.42.2(pid=12468): stderr: | 20221209203733218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203733218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203733218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203733218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203733218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203733218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203733230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203733239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203733240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203733240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:36.615964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Terminating (SIGTERM) 20:37:36.657678 run iperf3-srv_10.42.42.10(pid=12458): Terminating (SIGTERM) 20:37:36.699225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Terminating (SIGTERM) 20:37:36.741038 run iperf3-srv_10.42.42.10(pid=12460): Terminating (SIGTERM) 20:37:36.782425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Terminating (SIGTERM) 20:37:36.824147 run iperf3-srv_10.42.42.10(pid=12462): Terminating (SIGTERM) 20:37:36.865793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Terminating (SIGTERM) 20:37:36.907475 run iperf3-srv_10.42.42.10(pid=12464): Terminating (SIGTERM) 20:37:36.949147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Terminating (SIGTERM) 20:37:36.990944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminating (SIGTERM) 20:37:37.032695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminating (SIGTERM) 20:37:37.075306 --- ParallelTerminationStrategy: PID 12457 died... 20:37:37.095264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12457): Terminated: ok {rc=0} 20:37:37.141790 --- ParallelTerminationStrategy: PID 12458 died... 20:37:37.161367 run iperf3-srv_10.42.42.10(pid=12458): Terminated {rc=256} 20:37:37.207609 --- ParallelTerminationStrategy: PID 12459 died... 20:37:37.227113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12459): Terminated: ok {rc=0} 20:37:37.273218 --- ParallelTerminationStrategy: PID 12460 died... 20:37:37.292565 run iperf3-srv_10.42.42.10(pid=12460): Terminated {rc=256} 20:37:37.338630 --- ParallelTerminationStrategy: PID 12461 died... 20:37:37.358191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12461): Terminated: ok {rc=0} 20:37:37.403970 --- ParallelTerminationStrategy: PID 12462 died... 20:37:37.423550 run iperf3-srv_10.42.42.10(pid=12462): Terminated {rc=256} 20:37:37.469458 --- ParallelTerminationStrategy: PID 12463 died... 20:37:37.489012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12463): Terminated: ok {rc=0} 20:37:37.534907 --- ParallelTerminationStrategy: PID 12464 died... 20:37:37.554348 run iperf3-srv_10.42.42.10(pid=12464): Terminated {rc=256} 20:37:37.600226 --- ParallelTerminationStrategy: PID 12467 died... 20:37:37.619906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12467): Terminated: ok {rc=0} 20:37:37.665820 --- ParallelTerminationStrategy: PID 12470 died... 20:37:37.685423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12470): Terminated: ok {rc=0} 20:37:37.731531 --- ParallelTerminationStrategy: PID 12473 died... 20:37:37.751334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12473): Terminated: ok {rc=0} 20:37:37.839478 bus /gobi_4: Setting Powered False 20:37:38.938076 bus /gobi_4: Setting Powered False 20:37:40.055285 bus /gobi_1: Setting Powered False 20:37:41.154329 bus /gobi_1: Setting Powered False 20:37:42.271059 bus /gobi_0: Setting Powered False 20:37:43.369856 bus /gobi_0: Setting Powered False 20:37:44.489658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 20:37:45.592899 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:45.604534 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:45.655723 tst ping.py: using LAC 23571 20:37:45.775571 tst ping.py: using RAC 111 20:37:45.917217 tst ping.py: using CellId 23571 20:37:46.053100 tst ping.py: using BVCI 23572 20:37:46.173234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.185301 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.197805 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.210769 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.223306 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.236517 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.248886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:46.262417 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:46.405534 tst ping.py:19: start network... 20:37:46.618721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:47.153797 run create_hlr_db(pid=12477): Launched 20:37:47.320848 bus /gobi_6: Setting Powered False 20:37:48.385210 run create_hlr_db(pid=12477): Terminated: ok {rc=0} 20:37:48.837474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12479): Launched 20:37:49.160724 run osmo-hlr_10.42.42.2(pid=12480): Launched 20:37:49.283591 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:49.842815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12482): Launched 20:37:50.167020 run osmo-stp_10.42.42.5(pid=12483): Launched 20:37:50.291531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:50.850260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12485): Launched 20:37:50.973602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:51.247896 run patchelf(pid=12486): Launched 20:37:51.427487 run osmo-stp_10.42.42.5(pid=12483): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12483)] 20:37:51.564185 run osmo-stp_10.42.42.5(pid=12483): stdout: | (launched: 2022-12-09_20:37:50.107830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:51.702704 run osmo-stp_10.42.42.5(pid=12483): stderr: | 20221209203750300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203750301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203750301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203750301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203750302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203750302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203750302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:51.841175 run osmo-stp_10.42.42.5(pid=12483): stdout: | (launched: 2022-12-09_20:37:50.107830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:51.973588 run osmo-stp_10.42.42.5(pid=12483): stderr: | 20221209203750300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203750301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203750301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203750301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203750302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203750302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203750302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:37:52.130731 run patchelf(pid=12486): Terminating (SIGINT) 20:37:52.312064 run patchelf(pid=12486): Terminated: ok {rc=0} 20:37:52.442608 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12483): Process ended prematurely: osmo-stp_10.42.42.5(pid=12483) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12483)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 20:37:52.452209 tst ping.py:22: Test FAILED (6.9 sec) 20:37:52.480462 run osmo-hlr_10.42.42.2(pid=12480): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12480)] 20:37:52.530750 run osmo-hlr_10.42.42.2(pid=12480): stdout: | (launched: 2022-12-09_20:37:49.101571) 20:37:52.583187 run osmo-hlr_10.42.42.2(pid=12480): stderr: | 20221209203749303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203749303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203749303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203749303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203749303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203749303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203749316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203749325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203749325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203749325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:37:52.635481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12479): Terminating (SIGTERM) 20:37:52.677364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12482): Terminating (SIGTERM) 20:37:52.719281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12485): Terminating (SIGTERM) 20:37:52.761406 --- ParallelTerminationStrategy: PID 12479 died... 20:37:52.781448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12479): Terminated: ok {rc=0} 20:37:52.828020 --- ParallelTerminationStrategy: PID 12482 died... 20:37:52.847676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12482): Terminated: ok {rc=0} 20:37:52.894014 --- ParallelTerminationStrategy: PID 12485 died... 20:37:52.913732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12485): Terminated: ok {rc=0} 20:37:53.001252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:37:54.088639 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.100506 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:37:54.153067 tst ping_idle_ping.py: using LAC 23572 20:37:54.272780 tst ping_idle_ping.py: using RAC 112 20:37:54.391015 tst ping_idle_ping.py: using CellId 23572 20:37:54.510289 tst ping_idle_ping.py: using BVCI 23573 20:37:54.622057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.633358 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.644279 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.655389 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.666403 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.677468 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.688745 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:37:54.699802 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:37:54.815026 tst ping_idle_ping.py:24: start network... 20:37:55.016323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:37:55.485796 run create_hlr_db(pid=12487): Launched 20:37:55.600569 bus /gobi_6: Setting Powered False 20:37:56.661449 run create_hlr_db(pid=12487): Terminated: ok {rc=0} 20:37:57.103965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12489): Launched 20:37:57.428630 run osmo-hlr_10.42.42.2(pid=12490): Launched 20:37:57.553731 run osmo-stp_10.42.42.5: Starting osmo-stp 20:37:58.111030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12492): Launched 20:37:58.435311 run osmo-stp_10.42.42.5(pid=12493): Launched 20:37:58.560368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:37:59.122249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12495): Launched 20:37:59.247871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:37:59.522530 run patchelf(pid=12496): Launched 20:37:59.704197 run osmo-stp_10.42.42.5(pid=12493): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12493)] 20:37:59.841368 run osmo-stp_10.42.42.5(pid=12493): stdout: | (launched: 2022-12-09_20:37:58.376074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:37:59.980113 run osmo-stp_10.42.42.5(pid=12493): stderr: | 20221209203758568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203758569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203758569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203758570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203758572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203758572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203758572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:00.118756 run osmo-stp_10.42.42.5(pid=12493): stdout: | (launched: 2022-12-09_20:37:58.376074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:00.251500 run osmo-stp_10.42.42.5(pid=12493): stderr: | 20221209203758568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203758569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203758569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203758570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203758572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203758572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203758572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:00.408587 run patchelf(pid=12496): Terminating (SIGINT) 20:38:00.590374 run patchelf(pid=12496): Terminated: ok {rc=0} 20:38:00.720694 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12493): Process ended prematurely: osmo-stp_10.42.42.5(pid=12493) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12493)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 20:38:00.730541 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:38:00.758996 run osmo-hlr_10.42.42.2(pid=12490): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12490)] 20:38:00.809180 run osmo-hlr_10.42.42.2(pid=12490): stdout: | (launched: 2022-12-09_20:37:57.369325) 20:38:00.862088 run osmo-hlr_10.42.42.2(pid=12490): stderr: | 20221209203757570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203757570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203757570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203757570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203757570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203757570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203757582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203757590 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203757591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203757591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:00.924680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12489): Terminating (SIGTERM) 20:38:00.967420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12492): Terminating (SIGTERM) 20:38:01.010090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12495): Terminating (SIGTERM) 20:38:01.052912 --- ParallelTerminationStrategy: PID 12489 died... 20:38:01.073258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12489): Terminated: ok {rc=0} 20:38:01.142112 --- ParallelTerminationStrategy: PID 12492 died... 20:38:01.176791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12492): Terminated: ok {rc=0} 20:38:01.229904 --- ParallelTerminationStrategy: PID 12495 died... 20:38:01.250274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12495): Terminated: ok {rc=0} 20:38:01.347670 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:38:02.684053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:38:02.692180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:38:02.732006 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:38:02.772151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:38:02.864208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:38:02.899572 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:38:02.939661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:38:03.530646 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:38:03.586372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:03.598418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:03.670020 tst cs_paging_gprs_active.py: using LAC 23573 20:38:03.790578 tst cs_paging_gprs_active.py: using RAC 113 20:38:03.913449 tst cs_paging_gprs_active.py: using CellId 23573 20:38:04.035985 tst cs_paging_gprs_active.py: using BVCI 23574 20:38:04.154167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.166097 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.177938 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.190967 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.203854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.217906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.231067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.243236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:04.257310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:04.384239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:04.505899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:38:04.719571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:05.036437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12511): Launched 20:38:05.325327 run iperf3-srv_10.42.42.10(pid=12513): Launched 20:38:05.462256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:38:05.687381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:06.023582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12515): Launched 20:38:06.321797 run iperf3-srv_10.42.42.10(pid=12516): Launched 20:38:06.458379 tst cs_paging_gprs_active.py:38: start network... 20:38:06.683777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:07.208447 run create_hlr_db(pid=12517): Launched 20:38:07.402549 bus /gobi_6: Setting Powered False 20:38:08.487695 run create_hlr_db(pid=12517): Terminated: ok {rc=0} 20:38:09.006763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Launched 20:38:09.361935 run osmo-hlr_10.42.42.2(pid=12778): Launched 20:38:09.608104 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:10.336739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Launched 20:38:10.669429 run osmo-stp_10.42.42.5(pid=12781): Launched 20:38:10.931323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:11.583376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Launched 20:38:11.718607 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:11.990446 run patchelf(pid=12784): Launched 20:38:12.182759 run osmo-stp_10.42.42.5(pid=12781): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] 20:38:12.319797 run osmo-stp_10.42.42.5(pid=12781): stdout: | (launched: 2022-12-09_20:38:10.609604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:12.458551 run osmo-stp_10.42.42.5(pid=12781): stderr: | 20221209203810969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203810969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203810969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203810970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203810970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203810970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203810971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:12.596860 run osmo-stp_10.42.42.5(pid=12781): stdout: | (launched: 2022-12-09_20:38:10.609604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:12.731154 run osmo-stp_10.42.42.5(pid=12781): stderr: | 20221209203810969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203810969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203810969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203810970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203810970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203810970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203810971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:12.886908 run patchelf(pid=12784): Terminating (SIGINT) 20:38:13.066521 run patchelf(pid=12784): Terminated: ok {rc=0} 20:38:13.195866 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12781): Process ended prematurely: osmo-stp_10.42.42.5(pid=12781) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:38:13.207245 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 20:38:13.239159 run osmo-hlr_10.42.42.2(pid=12778): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12778)] 20:38:13.291954 run osmo-hlr_10.42.42.2(pid=12778): stdout: | (launched: 2022-12-09_20:38:09.299333) 20:38:13.345229 run osmo-hlr_10.42.42.2(pid=12778): stderr: | 20221209203809637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203809637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203809637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203809637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203809637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203809637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203809666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203809683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203809683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203809684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:13.398958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12511): Terminating (SIGTERM) 20:38:13.442473 run iperf3-srv_10.42.42.10(pid=12513): Terminating (SIGTERM) 20:38:13.490308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12515): Terminating (SIGTERM) 20:38:13.534245 run iperf3-srv_10.42.42.10(pid=12516): Terminating (SIGTERM) 20:38:13.580397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Terminating (SIGTERM) 20:38:13.624060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Terminating (SIGTERM) 20:38:13.668690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Terminating (SIGTERM) 20:38:13.714016 --- ParallelTerminationStrategy: PID 12511 died... 20:38:13.733946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12511): Terminated: ok {rc=0} 20:38:13.783836 --- ParallelTerminationStrategy: PID 12513 died... 20:38:13.803474 run iperf3-srv_10.42.42.10(pid=12513): Terminated {rc=256} 20:38:13.852084 --- ParallelTerminationStrategy: PID 12515 died... 20:38:13.873614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12515): Terminated: ok {rc=0} 20:38:13.921838 --- ParallelTerminationStrategy: PID 12516 died... 20:38:13.942046 run iperf3-srv_10.42.42.10(pid=12516): Terminated {rc=256} 20:38:13.990184 --- ParallelTerminationStrategy: PID 12777 died... 20:38:14.010225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Terminated: ok {rc=0} 20:38:14.059259 --- ParallelTerminationStrategy: PID 12780 died... 20:38:14.079394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Terminated: ok {rc=0} 20:38:14.128045 --- ParallelTerminationStrategy: PID 12783 died... 20:38:14.147987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Terminated: ok {rc=0} 20:38:14.237735 bus /gobi_0: Setting Powered False 20:38:15.342085 bus /gobi_0: Setting Powered False 20:38:16.479086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:38:17.656586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:17.670712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:17.746411 tst iperf3.py: using LAC 23574 20:38:17.880091 tst iperf3.py: using RAC 114 20:38:18.011425 tst iperf3.py: using CellId 23574 20:38:18.143061 tst iperf3.py: using BVCI 23575 20:38:18.269137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.281174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.293755 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.305867 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.317811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.330181 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.342147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.354620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:18.366799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:18.493189 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:38:18.723829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:19.064215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12785): Launched 20:38:19.374961 run iperf3-srv_10.42.42.10(pid=12786): Launched 20:38:19.520143 tst iperf3.py:8: start network... 20:38:19.751266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:20.282595 run create_hlr_db(pid=12787): Launched 20:38:20.456116 bus /gobi_6: Setting Powered False 20:38:21.524459 run create_hlr_db(pid=12787): Terminated: ok {rc=0} 20:38:21.998302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12789): Launched 20:38:22.349020 run osmo-hlr_10.42.42.2(pid=12790): Launched 20:38:22.606291 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:23.295613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12792): Launched 20:38:23.646893 run osmo-stp_10.42.42.5(pid=12793): Launched 20:38:23.773930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:24.341652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12795): Launched 20:38:24.466893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:24.744850 run patchelf(pid=12796): Launched 20:38:24.927613 run osmo-stp_10.42.42.5(pid=12793): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12793)] 20:38:25.066333 run osmo-stp_10.42.42.5(pid=12793): stdout: | (launched: 2022-12-09_20:38:23.586452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:25.206539 run osmo-stp_10.42.42.5(pid=12793): stderr: | 20221209203823781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203823781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203823781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203823782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203823782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203823782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203823782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:25.347579 run osmo-stp_10.42.42.5(pid=12793): stdout: | (launched: 2022-12-09_20:38:23.586452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:25.482106 run osmo-stp_10.42.42.5(pid=12793): stderr: | 20221209203823781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203823781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203823781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203823782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203823782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203823782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203823782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:25.641387 run patchelf(pid=12796): Terminating (SIGINT) 20:38:25.825159 run patchelf(pid=12796): Terminated: ok {rc=0} 20:38:25.957825 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12793): Process ended prematurely: osmo-stp_10.42.42.5(pid=12793) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12793)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 20:38:25.968250 tst iperf3.py:8: Test FAILED (8.4 sec) 20:38:25.996838 run osmo-hlr_10.42.42.2(pid=12790): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12790)] 20:38:26.046811 run osmo-hlr_10.42.42.2(pid=12790): stdout: | (launched: 2022-12-09_20:38:22.288363) 20:38:26.098520 run osmo-hlr_10.42.42.2(pid=12790): stderr: | 20221209203822604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203822604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203822604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203822604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203822604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203822604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203822623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203822635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203822635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203822636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:26.150882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12785): Terminating (SIGTERM) 20:38:26.192312 run iperf3-srv_10.42.42.10(pid=12786): Terminating (SIGTERM) 20:38:26.234152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12789): Terminating (SIGTERM) 20:38:26.275812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12792): Terminating (SIGTERM) 20:38:26.317309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12795): Terminating (SIGTERM) 20:38:26.359009 --- ParallelTerminationStrategy: PID 12785 died... 20:38:26.378880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12785): Terminated: ok {rc=0} 20:38:26.424870 --- ParallelTerminationStrategy: PID 12786 died... 20:38:26.444596 run iperf3-srv_10.42.42.10(pid=12786): Terminated {rc=256} 20:38:26.490532 --- ParallelTerminationStrategy: PID 12789 died... 20:38:26.510015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12789): Terminated: ok {rc=0} 20:38:26.555831 --- ParallelTerminationStrategy: PID 12792 died... 20:38:26.575274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12792): Terminated: ok {rc=0} 20:38:26.621253 --- ParallelTerminationStrategy: PID 12795 died... 20:38:26.640710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12795): Terminated: ok {rc=0} 20:38:26.728686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:38:27.874872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:27.886746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:27.958478 tst iperf3m4.py: using LAC 23575 20:38:28.081177 tst iperf3m4.py: using RAC 115 20:38:28.202577 tst iperf3m4.py: using CellId 23575 20:38:28.324846 tst iperf3m4.py: using BVCI 23576 20:38:28.436786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.448053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.458853 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.470454 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.482110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.493799 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.505611 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.516942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:28.529122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:28.648373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:28.773092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:28.891553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:29.012689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:38:29.237029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:29.568069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12797): Launched 20:38:29.855715 run iperf3-srv_10.42.42.10(pid=12798): Launched 20:38:29.979660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:38:30.203016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:30.534783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12799): Launched 20:38:30.822812 run iperf3-srv_10.42.42.10(pid=12800): Launched 20:38:30.974733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:38:31.201024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:31.541751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12801): Launched 20:38:31.829723 run iperf3-srv_10.42.42.10(pid=12802): Launched 20:38:32.016396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:38:32.244107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:38:32.575761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12803): Launched 20:38:32.862718 run iperf3-srv_10.42.42.10(pid=12804): Launched 20:38:32.987621 tst iperf3m4.py:8: start network... 20:38:33.210076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:33.722250 run create_hlr_db(pid=12805): Launched 20:38:33.856454 bus /gobi_6: Setting Powered False 20:38:34.922063 run create_hlr_db(pid=12805): Terminated: ok {rc=0} 20:38:35.361445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12807): Launched 20:38:35.670430 run osmo-hlr_10.42.42.2(pid=12808): Launched 20:38:35.787583 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:36.333162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12810): Launched 20:38:36.639707 run osmo-stp_10.42.42.5(pid=12811): Launched 20:38:36.756054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:37.287929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12813): Launched 20:38:37.405225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:37.665061 run patchelf(pid=12814): Launched 20:38:37.835319 run osmo-stp_10.42.42.5(pid=12811): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12811)] 20:38:37.965081 run osmo-stp_10.42.42.5(pid=12811): stdout: | (launched: 2022-12-09_20:38:36.583259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:38.096510 run osmo-stp_10.42.42.5(pid=12811): stderr: | 20221209203836755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203836756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203836756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203836756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203836757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203836757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203836757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:38.227694 run osmo-stp_10.42.42.5(pid=12811): stdout: | (launched: 2022-12-09_20:38:36.583259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:38.353656 run osmo-stp_10.42.42.5(pid=12811): stderr: | 20221209203836755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203836756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203836756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203836756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203836757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203836757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203836757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:38.502709 run patchelf(pid=12814): Terminating (SIGINT) 20:38:38.674540 run patchelf(pid=12814): Terminated: ok {rc=0} 20:38:38.798600 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12811): Process ended prematurely: osmo-stp_10.42.42.5(pid=12811) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12811)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:38:38.808241 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:38:38.836497 run osmo-hlr_10.42.42.2(pid=12808): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12808)] 20:38:38.884186 run osmo-hlr_10.42.42.2(pid=12808): stdout: | (launched: 2022-12-09_20:38:35.613794) 20:38:38.933988 run osmo-hlr_10.42.42.2(pid=12808): stderr: | 20221209203835792 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203835792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203835792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203835792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203835792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203835792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203835803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203835811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203835812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203835812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:38.983850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12797): Terminating (SIGTERM) 20:38:39.023305 run iperf3-srv_10.42.42.10(pid=12798): Terminating (SIGTERM) 20:38:39.062700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12799): Terminating (SIGTERM) 20:38:39.102293 run iperf3-srv_10.42.42.10(pid=12800): Terminating (SIGTERM) 20:38:39.141807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12801): Terminating (SIGTERM) 20:38:39.181429 run iperf3-srv_10.42.42.10(pid=12802): Terminating (SIGTERM) 20:38:39.220760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12803): Terminating (SIGTERM) 20:38:39.260066 run iperf3-srv_10.42.42.10(pid=12804): Terminating (SIGTERM) 20:38:39.299354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12807): Terminating (SIGTERM) 20:38:39.338923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12810): Terminating (SIGTERM) 20:38:39.378280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12813): Terminating (SIGTERM) 20:38:39.417940 --- ParallelTerminationStrategy: PID 12797 died... 20:38:39.436663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12797): Terminated: ok {rc=0} 20:38:39.481052 --- ParallelTerminationStrategy: PID 12798 died... 20:38:39.499358 run iperf3-srv_10.42.42.10(pid=12798): Terminated {rc=256} 20:38:39.542896 --- ParallelTerminationStrategy: PID 12799 died... 20:38:39.561215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12799): Terminated: ok {rc=0} 20:38:39.605198 --- ParallelTerminationStrategy: PID 12800 died... 20:38:39.623355 run iperf3-srv_10.42.42.10(pid=12800): Terminated {rc=256} 20:38:39.666915 --- ParallelTerminationStrategy: PID 12801 died... 20:38:39.685244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12801): Terminated: ok {rc=0} 20:38:39.729215 --- ParallelTerminationStrategy: PID 12802 died... 20:38:39.747407 run iperf3-srv_10.42.42.10(pid=12802): Terminated {rc=256} 20:38:39.790983 --- ParallelTerminationStrategy: PID 12803 died... 20:38:39.809410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12803): Terminated: ok {rc=0} 20:38:39.853393 --- ParallelTerminationStrategy: PID 12804 died... 20:38:39.871730 run iperf3-srv_10.42.42.10(pid=12804): Terminated {rc=256} 20:38:39.915348 --- ParallelTerminationStrategy: PID 12807 died... 20:38:39.933851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12807): Terminated: ok {rc=0} 20:38:39.977560 --- ParallelTerminationStrategy: PID 12810 died... 20:38:39.995951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12810): Terminated: ok {rc=0} 20:38:40.039639 --- ParallelTerminationStrategy: PID 12813 died... 20:38:40.058160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12813): Terminated: ok {rc=0} 20:38:40.143527 bus /gobi_4: Setting Powered False 20:38:41.244202 bus /gobi_4: Setting Powered False 20:38:42.360781 bus /gobi_1: Setting Powered False 20:38:43.458928 bus /gobi_1: Setting Powered False 20:38:44.577008 bus /gobi_0: Setting Powered False 20:38:45.675873 bus /gobi_0: Setting Powered False 20:38:46.793889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:38:47.900196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:47.912457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:47.985383 tst ping.py: using LAC 23576 20:38:48.114699 tst ping.py: using RAC 116 20:38:48.246191 tst ping.py: using CellId 23576 20:38:48.372410 tst ping.py: using BVCI 23577 20:38:48.491318 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.503110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.514688 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.526267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.537860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.549655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.561300 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:48.573236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:48.689180 tst ping.py:19: start network... 20:38:48.890852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:49.357571 run create_hlr_db(pid=12815): Launched 20:38:49.473084 bus /gobi_6: Setting Powered False 20:38:50.533336 run create_hlr_db(pid=12815): Terminated: ok {rc=0} 20:38:50.974003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12817): Launched 20:38:51.298467 run osmo-hlr_10.42.42.2(pid=12818): Launched 20:38:51.425124 run osmo-stp_10.42.42.5: Starting osmo-stp 20:38:51.986221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12820): Launched 20:38:52.309412 run osmo-stp_10.42.42.5(pid=12821): Launched 20:38:52.433285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:38:52.993260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12823): Launched 20:38:53.116935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:38:53.390755 run patchelf(pid=12824): Launched 20:38:53.571194 run osmo-stp_10.42.42.5(pid=12821): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12821)] 20:38:53.707451 run osmo-stp_10.42.42.5(pid=12821): stdout: | (launched: 2022-12-09_20:38:52.249476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:53.846190 run osmo-stp_10.42.42.5(pid=12821): stderr: | 20221209203852445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203852445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203852445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203852446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203852446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203852446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203852446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:53.984410 run osmo-stp_10.42.42.5(pid=12821): stdout: | (launched: 2022-12-09_20:38:52.249476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:38:54.116735 run osmo-stp_10.42.42.5(pid=12821): stderr: | 20221209203852445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203852445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203852445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203852446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203852446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203852446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203852446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:38:54.274177 run patchelf(pid=12824): Terminating (SIGINT) 20:38:54.455176 run patchelf(pid=12824): Terminated: ok {rc=0} 20:38:54.585550 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12821): Process ended prematurely: osmo-stp_10.42.42.5(pid=12821) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12821)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 20:38:54.595231 tst ping.py:22: Test FAILED (6.7 sec) 20:38:54.623816 run osmo-hlr_10.42.42.2(pid=12818): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12818)] 20:38:54.674270 run osmo-hlr_10.42.42.2(pid=12818): stdout: | (launched: 2022-12-09_20:38:51.239345) 20:38:54.726329 run osmo-hlr_10.42.42.2(pid=12818): stderr: | 20221209203851437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203851437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203851437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203851437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203851437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203851437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203851450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203851458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203851458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203851458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:38:54.778559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12817): Terminating (SIGTERM) 20:38:54.820341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12820): Terminating (SIGTERM) 20:38:54.862323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12823): Terminating (SIGTERM) 20:38:54.904820 --- ParallelTerminationStrategy: PID 12817 died... 20:38:54.925101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12817): Terminated: ok {rc=0} 20:38:54.971678 --- ParallelTerminationStrategy: PID 12820 died... 20:38:54.991579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12820): Terminated: ok {rc=0} 20:38:55.038152 --- ParallelTerminationStrategy: PID 12823 died... 20:38:55.058222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12823): Terminated: ok {rc=0} 20:38:55.146028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:38:56.234712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.247218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:38:56.319913 tst ping_idle_ping.py: using LAC 23577 20:38:56.445772 tst ping_idle_ping.py: using RAC 117 20:38:56.573435 tst ping_idle_ping.py: using CellId 23577 20:38:56.700665 tst ping_idle_ping.py: using BVCI 23578 20:38:56.818117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.829946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.841462 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.852814 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.864204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.875719 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.887355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:38:56.899266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:38:57.019266 tst ping_idle_ping.py:24: start network... 20:38:57.238511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:38:57.748191 run create_hlr_db(pid=12826): Launched 20:38:57.878881 bus /gobi_6: Setting Powered False 20:38:58.942625 run create_hlr_db(pid=12826): Terminated: ok {rc=0} 20:38:59.376116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12828): Launched 20:38:59.680884 run osmo-hlr_10.42.42.2(pid=12829): Launched 20:38:59.796800 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:00.321501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12831): Launched 20:39:00.623096 run osmo-stp_10.42.42.5(pid=12832): Launched 20:39:00.738542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:01.318457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12834): Launched 20:39:01.450714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:01.730846 run patchelf(pid=12835): Launched 20:39:01.914317 run osmo-stp_10.42.42.5(pid=12832): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12832)] 20:39:02.044858 run osmo-stp_10.42.42.5(pid=12832): stdout: | (launched: 2022-12-09_20:39:00.567754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:02.177582 run osmo-stp_10.42.42.5(pid=12832): stderr: | 20221209203900739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203900739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203900740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203900740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203900741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203900741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203900741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:02.307868 run osmo-stp_10.42.42.5(pid=12832): stdout: | (launched: 2022-12-09_20:39:00.567754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:02.431337 run osmo-stp_10.42.42.5(pid=12832): stderr: | 20221209203900739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203900739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203900740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203900740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203900741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203900741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203900741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:02.577698 run patchelf(pid=12835): Terminating (SIGINT) 20:39:02.746605 run patchelf(pid=12835): Terminated: ok {rc=0} 20:39:02.868538 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12832): Process ended prematurely: osmo-stp_10.42.42.5(pid=12832) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12832)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:39:02.877984 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:39:02.905205 run osmo-hlr_10.42.42.2(pid=12829): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12829)] 20:39:02.952748 run osmo-hlr_10.42.42.2(pid=12829): stdout: | (launched: 2022-12-09_20:38:59.624534) 20:39:03.002106 run osmo-hlr_10.42.42.2(pid=12829): stderr: | 20221209203859802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203859802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203859802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203859802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203859802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203859802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203859814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203859822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203859823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203859823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:03.051927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12828): Terminating (SIGTERM) 20:39:03.091998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12831): Terminating (SIGTERM) 20:39:03.131974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12834): Terminating (SIGTERM) 20:39:03.171996 --- ParallelTerminationStrategy: PID 12828 died... 20:39:03.190937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12828): Terminated: ok {rc=0} 20:39:03.235377 --- ParallelTerminationStrategy: PID 12831 died... 20:39:03.253887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12831): Terminated: ok {rc=0} 20:39:03.297927 --- ParallelTerminationStrategy: PID 12834 died... 20:39:03.316414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12834): Terminated: ok {rc=0} 20:39:03.403009 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:39:04.711147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:39:04.717624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:39:04.752190 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:39:04.790436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:39:04.876493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:39:04.910008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:39:04.947949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:39:05.544332 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:39:05.600143 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:05.611770 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:05.683763 tst cs_paging_gprs_active.py: using LAC 23578 20:39:05.807422 tst cs_paging_gprs_active.py: using RAC 118 20:39:05.929886 tst cs_paging_gprs_active.py: using CellId 23578 20:39:06.051284 tst cs_paging_gprs_active.py: using BVCI 23579 20:39:06.165253 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.176293 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.187270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.199036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.210582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.222049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.233713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.245277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:06.256793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:06.380555 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:06.498675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:39:06.707861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:07.017868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12840): Launched 20:39:07.288502 run iperf3-srv_10.42.42.10(pid=12841): Launched 20:39:07.404563 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:39:07.613850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:07.923980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12842): Launched 20:39:08.192005 run iperf3-srv_10.42.42.10(pid=12843): Launched 20:39:08.307024 tst cs_paging_gprs_active.py:38: start network... 20:39:08.513768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:08.992173 run create_hlr_db(pid=12844): Launched 20:39:09.109143 bus /gobi_6: Setting Powered False 20:39:10.173839 run create_hlr_db(pid=12844): Terminated: ok {rc=0} 20:39:10.611407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12846): Launched 20:39:10.918277 run osmo-hlr_10.42.42.2(pid=12847): Launched 20:39:11.035326 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:11.576330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12849): Launched 20:39:11.884149 run osmo-stp_10.42.42.5(pid=12850): Launched 20:39:12.001369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:12.529355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12852): Launched 20:39:12.646209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:12.905791 run patchelf(pid=12853): Launched 20:39:13.077064 run osmo-stp_10.42.42.5(pid=12850): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12850)] 20:39:13.207586 run osmo-stp_10.42.42.5(pid=12850): stdout: | (launched: 2022-12-09_20:39:11.826856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:13.339236 run osmo-stp_10.42.42.5(pid=12850): stderr: | 20221209203911998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203911998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203911999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203911999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203911999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203912000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203912000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:13.470656 run osmo-stp_10.42.42.5(pid=12850): stdout: | (launched: 2022-12-09_20:39:11.826856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:13.596215 run osmo-stp_10.42.42.5(pid=12850): stderr: | 20221209203911998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203911998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203911999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203911999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203911999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203912000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203912000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:13.745088 run patchelf(pid=12853): Terminating (SIGINT) 20:39:13.917407 run patchelf(pid=12853): Terminated: ok {rc=0} 20:39:14.041446 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12850): Process ended prematurely: osmo-stp_10.42.42.5(pid=12850) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12850)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:39:14.051162 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:39:14.078824 run osmo-hlr_10.42.42.2(pid=12847): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12847)] 20:39:14.126881 run osmo-hlr_10.42.42.2(pid=12847): stdout: | (launched: 2022-12-09_20:39:10.861988) 20:39:14.176095 run osmo-hlr_10.42.42.2(pid=12847): stderr: | 20221209203911036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203911036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203911036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203911036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203911036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203911037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203911048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203911058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203911058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203911059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:14.225973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12840): Terminating (SIGTERM) 20:39:14.265623 run iperf3-srv_10.42.42.10(pid=12841): Terminating (SIGTERM) 20:39:14.305264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12842): Terminating (SIGTERM) 20:39:14.344897 run iperf3-srv_10.42.42.10(pid=12843): Terminating (SIGTERM) 20:39:14.385061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12846): Terminating (SIGTERM) 20:39:14.424567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12849): Terminating (SIGTERM) 20:39:14.464168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12852): Terminating (SIGTERM) 20:39:14.503825 --- ParallelTerminationStrategy: PID 12840 died... 20:39:14.522764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12840): Terminated: ok {rc=0} 20:39:14.566897 --- ParallelTerminationStrategy: PID 12841 died... 20:39:14.585459 run iperf3-srv_10.42.42.10(pid=12841): Terminated {rc=256} 20:39:14.630005 --- ParallelTerminationStrategy: PID 12842 died... 20:39:14.648323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12842): Terminated: ok {rc=0} 20:39:14.692028 --- ParallelTerminationStrategy: PID 12843 died... 20:39:14.710257 run iperf3-srv_10.42.42.10(pid=12843): Terminated {rc=256} 20:39:14.754121 --- ParallelTerminationStrategy: PID 12846 died... 20:39:14.772384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12846): Terminated: ok {rc=0} 20:39:14.816387 --- ParallelTerminationStrategy: PID 12849 died... 20:39:14.834863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12849): Terminated: ok {rc=0} 20:39:14.879116 --- ParallelTerminationStrategy: PID 12852 died... 20:39:14.897533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12852): Terminated: ok {rc=0} 20:39:14.981292 bus /gobi_0: Setting Powered False 20:39:16.080690 bus /gobi_0: Setting Powered False 20:39:17.211370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:39:18.363230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:18.375266 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:18.451239 tst iperf3.py: using LAC 23579 20:39:18.581101 tst iperf3.py: using RAC 119 20:39:18.709759 tst iperf3.py: using CellId 23579 20:39:18.838000 tst iperf3.py: using BVCI 23580 20:39:18.957290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:18.968731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:18.980036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:18.991474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:19.002740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:19.013993 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:19.025409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:19.036617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:19.048083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:19.167231 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:39:19.390474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:19.719941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Launched 20:39:20.005664 run iperf3-srv_10.42.42.10(pid=12856): Launched 20:39:20.128296 tst iperf3.py:8: start network... 20:39:20.350890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:20.862211 run create_hlr_db(pid=12857): Launched 20:39:20.996641 bus /gobi_6: Setting Powered False 20:39:22.061719 run create_hlr_db(pid=12857): Terminated: ok {rc=0} 20:39:22.500635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Launched 20:39:22.807648 run osmo-hlr_10.42.42.2(pid=12860): Launched 20:39:22.925535 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:23.470440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Launched 20:39:23.777453 run osmo-stp_10.42.42.5(pid=12863): Launched 20:39:23.894827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:24.437629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12865): Launched 20:39:24.555226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:24.814856 run patchelf(pid=12866): Launched 20:39:24.985443 run osmo-stp_10.42.42.5(pid=12863): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] 20:39:25.115744 run osmo-stp_10.42.42.5(pid=12863): stdout: | (launched: 2022-12-09_20:39:23.720827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:25.247215 run osmo-stp_10.42.42.5(pid=12863): stderr: | 20221209203923893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203923894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203923894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203923894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203923895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203923895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203923895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:25.379827 run osmo-stp_10.42.42.5(pid=12863): stdout: | (launched: 2022-12-09_20:39:23.720827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:25.505924 run osmo-stp_10.42.42.5(pid=12863): stderr: | 20221209203923893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203923894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203923894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203923894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203923895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203923895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203923895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:25.655248 run patchelf(pid=12866): Terminating (SIGINT) 20:39:25.827359 run patchelf(pid=12866): Terminated: ok {rc=0} 20:39:25.952129 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12863): Process ended prematurely: osmo-stp_10.42.42.5(pid=12863) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 20:39:25.961922 tst iperf3.py:8: Test FAILED (7.6 sec) 20:39:25.989858 run osmo-hlr_10.42.42.2(pid=12860): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12860)] 20:39:26.038210 run osmo-hlr_10.42.42.2(pid=12860): stdout: | (launched: 2022-12-09_20:39:22.751471) 20:39:26.088220 run osmo-hlr_10.42.42.2(pid=12860): stderr: | 20221209203922928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203922928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203922928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203922928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203922929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203922929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203922941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203922949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203922949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203922950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:26.138468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Terminating (SIGTERM) 20:39:26.178609 run iperf3-srv_10.42.42.10(pid=12856): Terminating (SIGTERM) 20:39:26.218593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Terminating (SIGTERM) 20:39:26.258791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Terminating (SIGTERM) 20:39:26.298986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12865): Terminating (SIGTERM) 20:39:26.339076 --- ParallelTerminationStrategy: PID 12855 died... 20:39:26.358223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Terminated: ok {rc=0} 20:39:26.402326 --- ParallelTerminationStrategy: PID 12856 died... 20:39:26.420733 run iperf3-srv_10.42.42.10(pid=12856): Terminated {rc=256} 20:39:26.465514 --- ParallelTerminationStrategy: PID 12859 died... 20:39:26.484012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12859): Terminated: ok {rc=0} 20:39:26.528350 --- ParallelTerminationStrategy: PID 12862 died... 20:39:26.547044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12862): Terminated: ok {rc=0} 20:39:26.591312 --- ParallelTerminationStrategy: PID 12865 died... 20:39:26.610040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12865): Terminated: ok {rc=0} 20:39:26.696601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:39:27.845495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:27.857085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:27.927978 tst iperf3m4.py: using LAC 23580 20:39:28.048687 tst iperf3m4.py: using RAC 120 20:39:28.177644 tst iperf3m4.py: using CellId 23580 20:39:28.306484 tst iperf3m4.py: using BVCI 23581 20:39:28.425813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.437604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.449180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.460432 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.471818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.483161 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.494576 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.505820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:28.517475 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:28.635025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:28.757685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:28.875411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:28.994386 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:39:29.201657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:29.510410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12867): Launched 20:39:29.777475 run iperf3-srv_10.42.42.10(pid=12868): Launched 20:39:29.892727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:39:30.099353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:30.407756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12869): Launched 20:39:30.675263 run iperf3-srv_10.42.42.10(pid=12870): Launched 20:39:30.791994 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:39:31.001537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:31.345533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12871): Launched 20:39:31.669848 run iperf3-srv_10.42.42.10(pid=12872): Launched 20:39:31.810384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:39:32.038778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:39:32.374444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12873): Launched 20:39:32.660911 run iperf3-srv_10.42.42.10(pid=12874): Launched 20:39:32.783662 tst iperf3m4.py:8: start network... 20:39:33.005255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:33.517225 run create_hlr_db(pid=12875): Launched 20:39:33.650629 bus /gobi_6: Setting Powered False 20:39:34.715210 run create_hlr_db(pid=12875): Terminated: ok {rc=0} 20:39:35.170859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Launched 20:39:35.501089 run osmo-hlr_10.42.42.2(pid=12878): Launched 20:39:35.627566 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:36.193710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Launched 20:39:36.522753 run osmo-stp_10.42.42.5(pid=12881): Launched 20:39:36.648712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:37.214915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12883): Launched 20:39:37.340502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:37.619389 run patchelf(pid=12884): Launched 20:39:37.802932 run osmo-stp_10.42.42.5(pid=12881): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] 20:39:37.941713 run osmo-stp_10.42.42.5(pid=12881): stdout: | (launched: 2022-12-09_20:39:36.462422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:38.081702 run osmo-stp_10.42.42.5(pid=12881): stderr: | 20221209203936654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203936654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203936654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203936655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203936655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203936655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203936655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:38.221942 run osmo-stp_10.42.42.5(pid=12881): stdout: | (launched: 2022-12-09_20:39:36.462422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:38.356737 run osmo-stp_10.42.42.5(pid=12881): stderr: | 20221209203936654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203936654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203936654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203936655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203936655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203936655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203936655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:38.515858 run patchelf(pid=12884): Terminating (SIGINT) 20:39:38.699345 run patchelf(pid=12884): Terminated: ok {rc=0} 20:39:38.832057 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12881): Process ended prematurely: osmo-stp_10.42.42.5(pid=12881) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:39:38.842677 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:39:38.871816 run osmo-hlr_10.42.42.2(pid=12878): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12878)] 20:39:38.922163 run osmo-hlr_10.42.42.2(pid=12878): stdout: | (launched: 2022-12-09_20:39:35.440642) 20:39:38.974587 run osmo-hlr_10.42.42.2(pid=12878): stderr: | 20221209203935641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203935641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203935641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203935641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203935642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203935642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203935657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203935667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203935667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203935667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:39.026880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12867): Terminating (SIGTERM) 20:39:39.069069 run iperf3-srv_10.42.42.10(pid=12868): Terminating (SIGTERM) 20:39:39.111221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12869): Terminating (SIGTERM) 20:39:39.153585 run iperf3-srv_10.42.42.10(pid=12870): Terminating (SIGTERM) 20:39:39.195662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12871): Terminating (SIGTERM) 20:39:39.237848 run iperf3-srv_10.42.42.10(pid=12872): Terminating (SIGTERM) 20:39:39.280063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12873): Terminating (SIGTERM) 20:39:39.322354 run iperf3-srv_10.42.42.10(pid=12874): Terminating (SIGTERM) 20:39:39.364357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Terminating (SIGTERM) 20:39:39.407071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Terminating (SIGTERM) 20:39:39.449273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12883): Terminating (SIGTERM) 20:39:39.491640 --- ParallelTerminationStrategy: PID 12867 died... 20:39:39.511560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12867): Terminated: ok {rc=0} 20:39:39.558262 --- ParallelTerminationStrategy: PID 12868 died... 20:39:39.577862 run iperf3-srv_10.42.42.10(pid=12868): Terminated {rc=256} 20:39:39.623714 --- ParallelTerminationStrategy: PID 12869 died... 20:39:39.643287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12869): Terminated: ok {rc=0} 20:39:39.689724 --- ParallelTerminationStrategy: PID 12870 died... 20:39:39.709446 run iperf3-srv_10.42.42.10(pid=12870): Terminated {rc=256} 20:39:39.755681 --- ParallelTerminationStrategy: PID 12871 died... 20:39:39.775273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12871): Terminated: ok {rc=0} 20:39:39.822185 --- ParallelTerminationStrategy: PID 12872 died... 20:39:39.841879 run iperf3-srv_10.42.42.10(pid=12872): Terminated {rc=256} 20:39:39.887987 --- ParallelTerminationStrategy: PID 12873 died... 20:39:39.907714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12873): Terminated: ok {rc=0} 20:39:39.954748 --- ParallelTerminationStrategy: PID 12874 died... 20:39:39.974498 run iperf3-srv_10.42.42.10(pid=12874): Terminated {rc=256} 20:39:40.020708 --- ParallelTerminationStrategy: PID 12877 died... 20:39:40.040501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12877): Terminated: ok {rc=0} 20:39:40.086891 --- ParallelTerminationStrategy: PID 12880 died... 20:39:40.106656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12880): Terminated: ok {rc=0} 20:39:40.152934 --- ParallelTerminationStrategy: PID 12883 died... 20:39:40.172654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12883): Terminated: ok {rc=0} 20:39:40.260388 bus /gobi_4: Setting Powered False 20:39:41.362689 bus /gobi_4: Setting Powered False 20:39:42.479211 bus /gobi_1: Setting Powered False 20:39:43.579392 bus /gobi_1: Setting Powered False 20:39:44.697073 bus /gobi_0: Setting Powered False 20:39:45.795503 bus /gobi_0: Setting Powered False 20:39:46.957284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:39:48.064105 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.077661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:48.148619 tst ping.py: using LAC 23581 20:39:48.271769 tst ping.py: using RAC 121 20:39:48.397203 tst ping.py: using CellId 23581 20:39:48.521537 tst ping.py: using BVCI 23582 20:39:48.640370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.652118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.663651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.675140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.686382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.697707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.709226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:48.720490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:48.836321 tst ping.py:19: start network... 20:39:49.037055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:49.503573 run create_hlr_db(pid=12885): Launched 20:39:49.618462 bus /gobi_6: Setting Powered False 20:39:50.678909 run create_hlr_db(pid=12885): Terminated: ok {rc=0} 20:39:51.118796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Launched 20:39:51.443590 run osmo-hlr_10.42.42.2(pid=12888): Launched 20:39:51.569641 run osmo-stp_10.42.42.5: Starting osmo-stp 20:39:52.137686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Launched 20:39:52.458737 run osmo-stp_10.42.42.5(pid=12891): Launched 20:39:52.582274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:39:53.137786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12893): Launched 20:39:53.260336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:39:53.535457 run patchelf(pid=12894): Launched 20:39:53.714835 run osmo-stp_10.42.42.5(pid=12891): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] 20:39:53.850996 run osmo-stp_10.42.42.5(pid=12891): stdout: | (launched: 2022-12-09_20:39:52.400157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:53.988826 run osmo-stp_10.42.42.5(pid=12891): stderr: | 20221209203952596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203952596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203952596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203952597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203952597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203952597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203952597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:54.126601 run osmo-stp_10.42.42.5(pid=12891): stdout: | (launched: 2022-12-09_20:39:52.400157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:39:54.258577 run osmo-stp_10.42.42.5(pid=12891): stderr: | 20221209203952596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209203952596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209203952596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209203952597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209203952597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209203952597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209203952597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:39:54.415381 run patchelf(pid=12894): Terminating (SIGINT) 20:39:54.595488 run patchelf(pid=12894): Terminated: ok {rc=0} 20:39:54.725104 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12891): Process ended prematurely: osmo-stp_10.42.42.5(pid=12891) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 20:39:54.734783 tst ping.py:22: Test FAILED (6.7 sec) 20:39:54.763123 run osmo-hlr_10.42.42.2(pid=12888): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12888)] 20:39:54.813119 run osmo-hlr_10.42.42.2(pid=12888): stdout: | (launched: 2022-12-09_20:39:51.384314) 20:39:54.864573 run osmo-hlr_10.42.42.2(pid=12888): stderr: | 20221209203951585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203951585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203951585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203951585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203951585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203951585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203951601 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203951611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203951611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203951611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:39:54.916679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Terminating (SIGTERM) 20:39:54.958406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Terminating (SIGTERM) 20:39:55.000135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12893): Terminating (SIGTERM) 20:39:55.042303 --- ParallelTerminationStrategy: PID 12887 died... 20:39:55.062243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12887): Terminated: ok {rc=0} 20:39:55.108606 --- ParallelTerminationStrategy: PID 12890 died... 20:39:55.128082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12890): Terminated: ok {rc=0} 20:39:55.174034 --- ParallelTerminationStrategy: PID 12893 died... 20:39:55.193536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12893): Terminated: ok {rc=0} 20:39:55.281122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:39:56.368752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.380659 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:39:56.452199 tst ping_idle_ping.py: using LAC 23582 20:39:56.571306 tst ping_idle_ping.py: using RAC 122 20:39:56.691109 tst ping_idle_ping.py: using CellId 23582 20:39:56.817709 tst ping_idle_ping.py: using BVCI 23583 20:39:56.935133 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.946675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.958040 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.969474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.980665 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:56.992048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:57.003486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:39:57.014906 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:39:57.134031 tst ping_idle_ping.py:24: start network... 20:39:57.351857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:39:57.855612 run create_hlr_db(pid=12895): Launched 20:39:57.986039 bus /gobi_6: Setting Powered False 20:39:59.049483 run create_hlr_db(pid=12895): Terminated: ok {rc=0} 20:39:59.481577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12897): Launched 20:39:59.784921 run osmo-hlr_10.42.42.2(pid=12898): Launched 20:39:59.899678 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:00.432931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12900): Launched 20:40:00.735639 run osmo-stp_10.42.42.5(pid=12901): Launched 20:40:00.887399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:40:01.569711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12903): Launched 20:40:01.725679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:40:01.994004 run patchelf(pid=12907): Launched 20:40:02.182896 run osmo-stp_10.42.42.5(pid=12901): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12901)] 20:40:02.314836 run osmo-stp_10.42.42.5(pid=12901): stdout: | (launched: 2022-12-09_20:40:00.680077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:02.448159 run osmo-stp_10.42.42.5(pid=12901): stderr: | 20221209204000890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204000890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204000890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204000891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204000891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204000891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204000891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:02.578768 run osmo-stp_10.42.42.5(pid=12901): stdout: | (launched: 2022-12-09_20:40:00.680077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:02.703316 run osmo-stp_10.42.42.5(pid=12901): stderr: | 20221209204000890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204000890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204000890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204000891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204000891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204000891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204000891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:02.850754 run patchelf(pid=12907): Terminating (SIGINT) 20:40:03.021798 run patchelf(pid=12907): Terminated: ok {rc=0} 20:40:03.144747 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12901): Process ended prematurely: osmo-stp_10.42.42.5(pid=12901) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12901)] [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:40:03.154243 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:40:03.181955 run osmo-hlr_10.42.42.2(pid=12898): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12898)] 20:40:03.230237 run osmo-hlr_10.42.42.2(pid=12898): stdout: | (launched: 2022-12-09_20:39:59.729467) 20:40:03.280003 run osmo-hlr_10.42.42.2(pid=12898): stderr: | 20221209203959908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209203959908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209203959908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209203959908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209203959908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209203959908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209203959920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209203959929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209203959929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209203959929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:03.330251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12897): Terminating (SIGTERM) 20:40:03.370503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12900): Terminating (SIGTERM) 20:40:03.410887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12903): Terminating (SIGTERM) 20:40:03.451301 --- ParallelTerminationStrategy: PID 12897 died... 20:40:03.470401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12897): Terminated: ok {rc=0} 20:40:03.515181 --- ParallelTerminationStrategy: PID 12900 died... 20:40:03.534394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12900): Terminated: ok {rc=0} 20:40:03.579795 --- ParallelTerminationStrategy: PID 12903 died... 20:40:03.598678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12903): Terminated: ok {rc=0} 20:40:03.683464 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:40:04.995096 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:05.002794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:40:05.037888 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:40:05.073208 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:40:05.127898 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:40:05.162134 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:40:05.197068 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:40:05.757769 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:40:05.763026 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:05.774785 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:40:05.846280 tst switch_tch_pdch.py: using LAC 23583 20:40:05.973704 tst switch_tch_pdch.py: using RAC 123 20:40:06.099330 tst switch_tch_pdch.py: using CellId 23583 20:40:06.219427 tst switch_tch_pdch.py: using BVCI 23584 20:40:06.330644 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.342090 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.353379 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.365131 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.376674 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.388238 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.402470 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:40:06.414121 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:40:06.531336 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:40:06.649662 tst switch_tch_pdch.py:51: start network... 20:40:06.866329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:07.367886 run create_hlr_db(pid=12911): Launched 20:40:07.499821 bus /gobi_6: Setting Powered False 20:40:08.564266 run create_hlr_db(pid=12911): Terminated: ok {rc=0} 20:40:09.013350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Launched 20:40:09.335778 run osmo-hlr_10.42.42.2(pid=12914): Launched 20:40:09.459300 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:10.017260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Launched 20:40:10.338413 run osmo-stp_10.42.42.5(pid=12917): Launched 20:40:10.462234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:40:10.987213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12919): Launched 20:40:11.110598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:40:11.365117 run patchelf(pid=12920): Launched 20:40:11.531904 run osmo-stp_10.42.42.5(pid=12917): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] 20:40:11.659425 run osmo-stp_10.42.42.5(pid=12917): stdout: | (launched: 2022-12-09_20:40:10.279208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:11.788465 run osmo-stp_10.42.42.5(pid=12917): stderr: | 20221209204010473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204010473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204010473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204010473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204010474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204010474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204010474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:11.917936 run osmo-stp_10.42.42.5(pid=12917): stdout: | (launched: 2022-12-09_20:40:10.279208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:12.041072 run osmo-stp_10.42.42.5(pid=12917): stderr: | 20221209204010473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204010473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204010473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204010473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204010474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204010474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204010474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:12.187113 run patchelf(pid=12920): Terminating (SIGINT) 20:40:12.355699 run patchelf(pid=12920): Terminated: ok {rc=0} 20:40:12.477100 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12917): Process ended prematurely: osmo-stp_10.42.42.5(pid=12917) [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:40:12.486372 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:40:12.513635 run osmo-hlr_10.42.42.2(pid=12914): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12914)] 20:40:12.561576 run osmo-hlr_10.42.42.2(pid=12914): stdout: | (launched: 2022-12-09_20:40:09.276392) 20:40:12.611089 run osmo-hlr_10.42.42.2(pid=12914): stderr: | 20221209204009478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204009478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204009478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204009478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204009478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204009478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204009491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204009499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204009499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204009499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:12.660925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Terminating (SIGTERM) 20:40:12.700741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Terminating (SIGTERM) 20:40:12.740382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12919): Terminating (SIGTERM) 20:40:12.780625 --- ParallelTerminationStrategy: PID 12913 died... 20:40:12.799920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12913): Terminated: ok {rc=0} 20:40:12.844076 --- ParallelTerminationStrategy: PID 12916 died... 20:40:12.862408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12916): Terminated: ok {rc=0} 20:40:12.906285 --- ParallelTerminationStrategy: PID 12919 died... 20:40:12.924795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12919): Terminated: ok {rc=0} 20:40:13.007968 bus /gobi_0: Setting Powered False 20:40:14.106842 bus /gobi_0: Setting Powered False 20:40:15.222640 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:40:16.518918 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:16.527041 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:40:16.563372 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:40:16.599787 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:40:16.654298 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:40:16.691645 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:40:16.728796 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:40:17.286663 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:40:17.292471 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.306061 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:40:17.379684 tst switch_tch_pdch.py: using LAC 23584 20:40:17.508205 tst switch_tch_pdch.py: using RAC 124 20:40:17.637094 tst switch_tch_pdch.py: using CellId 23584 20:40:17.765688 tst switch_tch_pdch.py: using BVCI 23585 20:40:17.884794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.896471 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.907809 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.919898 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.931559 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.943386 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.955387 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:40:17.967269 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:40:18.086045 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:40:18.202999 tst switch_tch_pdch.py:51: start network... 20:40:18.404394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:18.845064 run create_hlr_db(pid=12924): Launched 20:40:18.960016 bus /gobi_6: Setting Powered False 20:40:20.020114 run create_hlr_db(pid=12924): Terminated: ok {rc=0} 20:40:20.434397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12926): Launched 20:40:20.758944 run osmo-hlr_10.42.42.2(pid=12927): Launched 20:40:20.883583 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:21.415082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12929): Launched 20:40:21.738212 run osmo-stp_10.42.42.5(pid=12930): Launched 20:40:21.862499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:40:22.391577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12932): Launched 20:40:22.514649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:40:22.786222 run patchelf(pid=12933): Launched 20:40:22.965901 run osmo-stp_10.42.42.5(pid=12930): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12930)] 20:40:23.102079 run osmo-stp_10.42.42.5(pid=12930): stdout: | (launched: 2022-12-09_20:40:21.678729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:23.239887 run osmo-stp_10.42.42.5(pid=12930): stderr: | 20221209204021873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204021873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204021874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204021874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204021874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204021875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204021875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:23.378178 run osmo-stp_10.42.42.5(pid=12930): stdout: | (launched: 2022-12-09_20:40:21.678729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:23.509890 run osmo-stp_10.42.42.5(pid=12930): stderr: | 20221209204021873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204021873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204021874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204021874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204021874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204021875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204021875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:23.665974 run patchelf(pid=12933): Terminating (SIGINT) 20:40:23.846053 run patchelf(pid=12933): Terminated: ok {rc=0} 20:40:23.975440 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12930): Process ended prematurely: osmo-stp_10.42.42.5(pid=12930) [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12930)] [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:40:23.984884 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:40:24.013150 run osmo-hlr_10.42.42.2(pid=12927): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12927)] 20:40:24.062928 run osmo-hlr_10.42.42.2(pid=12927): stdout: | (launched: 2022-12-09_20:40:20.699998) 20:40:24.114580 run osmo-hlr_10.42.42.2(pid=12927): stderr: | 20221209204020900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204020900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204020900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204020900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204020900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204020900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204020912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204020922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204020922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204020922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:24.166665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12926): Terminating (SIGTERM) 20:40:24.208510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12929): Terminating (SIGTERM) 20:40:24.250512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12932): Terminating (SIGTERM) 20:40:24.293122 --- ParallelTerminationStrategy: PID 12926 died... 20:40:24.313185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12926): Terminated: ok {rc=0} 20:40:24.359955 --- ParallelTerminationStrategy: PID 12929 died... 20:40:24.379579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12929): Terminated: ok {rc=0} 20:40:24.425653 --- ParallelTerminationStrategy: PID 12932 died... 20:40:24.445398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12932): Terminated: ok {rc=0} 20:40:24.532493 bus /gobi_0: Setting Powered False 20:40:25.631601 bus /gobi_0: Setting Powered False 20:40:26.747392 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:trx-umtrx --------------------------------------------------------------------- 20:40:28.002597 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:28.006831 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:28.039959 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 20:40:28.047186 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 20:40:28.099572 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:28.132320 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 20:40:28.139087 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 20:40:28.674412 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 20:40:28.679564 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 20:40:28.690102 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:28.741437 tst mo_mt_sms.py: using LAC 23585 20:40:28.864288 tst mo_mt_sms.py: using RAC 125 20:40:28.986752 tst mo_mt_sms.py: using CellId 23585 20:40:29.108218 tst mo_mt_sms.py: using BVCI 23586 20:40:29.221981 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:29.337508 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:29.453146 tst mo_mt_sms.py:9: start nitb and bts... 20:40:29.666086 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:40:30.308406 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12937): Launched 20:40:30.623541 run osmo-nitb_10.42.42.2(pid=12938): Launched 20:40:30.797337 run osmo-nitb_10.42.42.2(pid=12938): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12938)] 20:40:30.957733 run osmo-nitb_10.42.42.2(pid=12938): stdout: | (launched: 2022-12-09_20:40:30.565879) 20:40:31.102507 run osmo-nitb_10.42.42.2(pid=12938): stderr: | (launched: 2022-12-09_20:40:30.612880) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:31.246863 run osmo-nitb_10.42.42.2(pid=12938): stdout: | (launched: 2022-12-09_20:40:30.565879) 20:40:31.387493 run osmo-nitb_10.42.42.2(pid=12938): stderr: | (launched: 2022-12-09_20:40:30.612880) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12938) [trial-2364↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12938)] 20:40:31.741759 tst osmo-nitb_10.42.42.2(pid=12938): stdout: | (launched: 2022-12-09_20:40:30.565879) 20:40:31.871769 tst osmo-nitb_10.42.42.2(pid=12938): stderr: | (launched: 2022-12-09_20:40:30.612880) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:32.024817 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12938) [trial-2364↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12938)] [trial-2364↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 20:40:32.034481 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 20:40:32.042067 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12937): Terminating (SIGTERM) 20:40:32.254961 --- ParallelTerminationStrategy: PID 12937 died... 20:40:32.274503 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12937): Terminated: ok {rc=0} 20:40:32.363389 bus /sierra_3: Setting Powered False 20:40:33.461320 bus /sierra_3: Setting Powered False 20:40:34.576209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:trx-umtrx --------------------------------------------------------------------- 20:40:35.773500 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:35.778130 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:35.811006 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:40:35.838283 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 20:40:35.891350 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:35.924336 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:40:35.951193 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 20:40:36.497953 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 20:40:36.502996 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:36.513913 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:36.565838 tst mo_mt_sms.py: using LAC 23586 20:40:36.689368 tst mo_mt_sms.py: using RAC 126 20:40:36.811451 tst mo_mt_sms.py: using CellId 23586 20:40:36.937199 tst mo_mt_sms.py: using BVCI 23587 20:40:37.051925 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:37.062832 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:37.073629 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:37.084299 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:37.095037 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:37.105794 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:37.222528 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 20:40:37.336419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:37.789642 run create_hlr_db(pid=12944): Launched 20:40:37.902694 bus /sierra_2: Setting Powered False 20:40:38.961187 run create_hlr_db(pid=12944): Terminated: ok {rc=0} 20:40:39.368218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12946): Launched 20:40:39.659569 run osmo-hlr_10.42.42.2(pid=12947): Launched 20:40:39.770546 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:40.284854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12949): Launched 20:40:40.578062 run osmo-stp_10.42.42.5(pid=12950): Launched 20:40:40.689738 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:41.218610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12952): Launched 20:40:41.510062 run osmo-msc_10.42.42.6(pid=12953): Launched 20:40:41.673583 run osmo-stp_10.42.42.5(pid=12950): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12950)] 20:40:41.796814 run osmo-stp_10.42.42.5(pid=12950): stdout: | (launched: 2022-12-09_20:40:40.524153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:41.945356 run osmo-stp_10.42.42.5(pid=12950): stderr: | 20221209204040692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204040692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204040692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204040693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204040695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204040695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204040695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:42.076320 run osmo-stp_10.42.42.5(pid=12950): stdout: | (launched: 2022-12-09_20:40:40.524153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:42.201194 run osmo-stp_10.42.42.5(pid=12950): stderr: | 20221209204040692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204040692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204040692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204040693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204040695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204040695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204040695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:42.350970 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12950): Process ended prematurely: osmo-stp_10.42.42.5(pid=12950) [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12950)] [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py:16] 20:40:42.360070 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 20:40:42.387561 run osmo-hlr_10.42.42.2(pid=12947): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12947)] 20:40:42.437542 run osmo-hlr_10.42.42.2(pid=12947): stdout: | (launched: 2022-12-09_20:40:39.605867) 20:40:42.489160 run osmo-hlr_10.42.42.2(pid=12947): stderr: | 20221209204039782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204039782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204039782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204039782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204039782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204039782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204039797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204039806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204039807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204039807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:42.561177 run osmo-msc_10.42.42.6(pid=12953): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12953)] 20:40:42.610927 run osmo-msc_10.42.42.6(pid=12953): stdout: | (launched: 2022-12-09_20:40:41.456432) 20:40:42.662621 run osmo-msc_10.42.42.6(pid=12953): stderr: | 20221209204041726 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204041726 DLGLOBAL DEBUG validating counter group 0x7f5c656d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204041726 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204041726 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204041726 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204041727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204041728 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204041729 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204041729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204041729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:42.714460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12946): Terminating (SIGTERM) 20:40:42.755885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12949): Terminating (SIGTERM) 20:40:42.799737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12952): Terminating (SIGTERM) 20:40:42.841651 --- ParallelTerminationStrategy: PID 12946 died... 20:40:42.861391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12946): Terminated: ok {rc=0} 20:40:42.907797 --- ParallelTerminationStrategy: PID 12949 died... 20:40:42.927190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12949): Terminated: ok {rc=0} 20:40:42.973015 --- ParallelTerminationStrategy: PID 12952 died... 20:40:42.992345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12952): Terminated: ok {rc=0} 20:40:43.079781 bus /sierra_3: Setting Powered False 20:40:44.177082 bus /sierra_3: Setting Powered False 20:40:45.291592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 20:40:46.558315 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:46.563766 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:46.600449 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 20:40:46.608035 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 20:40:46.647410 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:46.683566 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 20:40:46.691162 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 20:40:47.225233 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 20:40:47.231682 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 20:40:47.243672 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:47.292935 tst assert_extension.py: using LAC 23587 20:40:47.410483 tst assert_extension.py: using RAC 127 20:40:47.528831 tst assert_extension.py: using CellId 23587 20:40:47.645293 tst assert_extension.py: using BVCI 23588 20:40:47.750905 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 20:40:47.868227 tst assert_extension.py:10: start nitb and bts... 20:40:48.080308 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:40:48.721180 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12958): Launched 20:40:49.034009 run osmo-nitb_10.42.42.2(pid=12959): Launched 20:40:49.207229 run osmo-nitb_10.42.42.2(pid=12959): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12959)] 20:40:49.347902 run osmo-nitb_10.42.42.2(pid=12959): stdout: | (launched: 2022-12-09_20:40:48.976917) 20:40:49.489401 run osmo-nitb_10.42.42.2(pid=12959): stderr: | (launched: 2022-12-09_20:40:49.023637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:49.631197 run osmo-nitb_10.42.42.2(pid=12959): stdout: | (launched: 2022-12-09_20:40:48.976917) 20:40:49.767492 run osmo-nitb_10.42.42.2(pid=12959): stderr: | (launched: 2022-12-09_20:40:49.023637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12959) [trial-2364↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12959)] 20:40:50.151610 tst osmo-nitb_10.42.42.2(pid=12959): stdout: | (launched: 2022-12-09_20:40:48.976917) 20:40:50.278227 tst osmo-nitb_10.42.42.2(pid=12959): stderr: | (launched: 2022-12-09_20:40:49.023637) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:40:50.428292 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12959) [trial-2364↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12959)] [trial-2364↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 20:40:50.437401 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:40:50.444492 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12958): Terminating (SIGTERM) 20:40:50.654201 --- ParallelTerminationStrategy: PID 12958 died... 20:40:50.675734 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12958): Terminated: ok {rc=0} 20:40:50.761486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:trx-umtrx --------------------------------------------------------------------- 20:40:51.931409 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:40:51.935367 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:40:51.968408 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:40:51.994636 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 20:40:52.029247 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:40:52.061210 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:40:52.087465 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 20:40:52.615302 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 20:40:52.620407 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:52.630990 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 20:40:52.677859 tst assert_extension.py: using LAC 23588 20:40:52.794748 tst assert_extension.py: using RAC 128 20:40:52.909597 tst assert_extension.py: using CellId 23588 20:40:53.033130 tst assert_extension.py: using BVCI 23589 20:40:53.141520 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:53.152119 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:53.162639 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:53.173463 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:53.184156 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:40:53.194857 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 20:40:53.312449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:40:53.765364 run create_hlr_db(pid=12963): Launched 20:40:53.876931 bus /sierra_2: Setting Powered False 20:40:54.935759 run create_hlr_db(pid=12963): Terminated: ok {rc=0} 20:40:55.366401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Launched 20:40:55.680577 run osmo-hlr_10.42.42.2(pid=12966): Launched 20:40:55.801183 run osmo-stp_10.42.42.5: Starting osmo-stp 20:40:56.351586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Launched 20:40:56.664680 run osmo-stp_10.42.42.5(pid=12969): Launched 20:40:56.783777 run osmo-msc_10.42.42.6: Starting osmo-msc 20:40:57.349340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Launched 20:40:57.666808 run osmo-msc_10.42.42.6(pid=12972): Launched 20:40:57.839505 run osmo-stp_10.42.42.5(pid=12969): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] 20:40:57.971558 run osmo-stp_10.42.42.5(pid=12969): stdout: | (launched: 2022-12-09_20:40:56.607492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:58.105434 run osmo-stp_10.42.42.5(pid=12969): stderr: | 20221209204056799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204056799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204056800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204056800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204056800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204056801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204056801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:58.236915 run osmo-stp_10.42.42.5(pid=12969): stdout: | (launched: 2022-12-09_20:40:56.607492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:40:58.362474 run osmo-stp_10.42.42.5(pid=12969): stderr: | 20221209204056799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204056799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204056800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204056800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204056800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204056801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204056801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:40:58.512014 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12969): Process ended prematurely: osmo-stp_10.42.42.5(pid=12969) [trial-2364↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] [trial-2364↪ussd:trx-umtrx↪assert_extension.py:17] 20:40:58.521140 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:40:58.548294 run osmo-hlr_10.42.42.2(pid=12966): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12966)] 20:40:58.598177 run osmo-hlr_10.42.42.2(pid=12966): stdout: | (launched: 2022-12-09_20:40:55.623438) 20:40:58.649476 run osmo-hlr_10.42.42.2(pid=12966): stderr: | 20221209204055821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204055821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204055821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204055821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204055821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204055821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204055834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204055843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204055844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204055844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:40:58.720829 run osmo-msc_10.42.42.6(pid=12972): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12972)] 20:40:58.769905 run osmo-msc_10.42.42.6(pid=12972): stdout: | (launched: 2022-12-09_20:40:57.605254) 20:40:58.820524 run osmo-msc_10.42.42.6(pid=12972): stderr: | 20221209204057927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204057927 DLGLOBAL DEBUG validating counter group 0x7f926f895c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204057927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204057927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204057927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204057928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204057929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204057930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204057930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204057930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:40:58.871831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Terminating (SIGTERM) 20:40:58.913041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Terminating (SIGTERM) 20:40:58.954423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Terminating (SIGTERM) 20:40:58.996159 --- ParallelTerminationStrategy: PID 12965 died... 20:40:59.015934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12965): Terminated: ok {rc=0} 20:40:59.061678 --- ParallelTerminationStrategy: PID 12968 died... 20:40:59.080811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12968): Terminated: ok {rc=0} 20:40:59.126320 --- ParallelTerminationStrategy: PID 12971 died... 20:40:59.145733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12971): Terminated: ok {rc=0} 20:40:59.232115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:41:00.446388 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:00.453710 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:41:00.487379 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:41:00.514541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:41:00.565117 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:41:00.598134 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:41:00.625347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:41:01.207046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:41:01.267528 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.279646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:41:01.350211 tst mo_mt_call.py: using LAC 23589 20:41:01.476419 tst mo_mt_call.py: using RAC 129 20:41:01.601355 tst mo_mt_call.py: using CellId 23589 20:41:01.757061 tst mo_mt_call.py: using BVCI 23590 20:41:01.882929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.894916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.906777 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.918778 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.930952 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:01.943206 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:41:02.066747 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:41:02.186027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:02.648847 run create_hlr_db(pid=12977): Launched 20:41:02.762551 bus /sierra_2: Setting Powered False 20:41:03.822831 run create_hlr_db(pid=12977): Terminated: ok {rc=0} 20:41:04.257186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Launched 20:41:04.574633 run osmo-hlr_10.42.42.2(pid=12980): Launched 20:41:04.695872 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:05.241501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Launched 20:41:05.559718 run osmo-stp_10.42.42.5(pid=12983): Launched 20:41:05.681477 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:06.257318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Launched 20:41:06.575106 run osmo-msc_10.42.42.6(pid=12986): Launched 20:41:06.752581 run osmo-stp_10.42.42.5(pid=12983): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] 20:41:06.886889 run osmo-stp_10.42.42.5(pid=12983): stdout: | (launched: 2022-12-09_20:41:05.502184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:07.020347 run osmo-stp_10.42.42.5(pid=12983): stderr: | 20221209204105693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204105693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204105693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204105693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204105694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204105694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204105694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:07.153747 run osmo-stp_10.42.42.5(pid=12983): stdout: | (launched: 2022-12-09_20:41:05.502184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:07.280148 run osmo-stp_10.42.42.5(pid=12983): stderr: | 20221209204105693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204105693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204105693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204105693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204105694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204105694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204105694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:07.432212 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12983): Process ended prematurely: osmo-stp_10.42.42.5(pid=12983) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:41:07.441976 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:41:07.469520 run osmo-hlr_10.42.42.2(pid=12980): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12980)] 20:41:07.518775 run osmo-hlr_10.42.42.2(pid=12980): stdout: | (launched: 2022-12-09_20:41:04.517267) 20:41:07.569599 run osmo-hlr_10.42.42.2(pid=12980): stderr: | 20221209204104714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204104714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204104714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204104714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204104714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204104714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204104726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204104735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204104735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204104735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:07.640401 run osmo-msc_10.42.42.6(pid=12986): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12986)] 20:41:07.689427 run osmo-msc_10.42.42.6(pid=12986): stdout: | (launched: 2022-12-09_20:41:06.517465) 20:41:07.739986 run osmo-msc_10.42.42.6(pid=12986): stderr: | 20221209204106836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204106836 DLGLOBAL DEBUG validating counter group 0x7f335d78cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204106836 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204106836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204106837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204106837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204106839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204106839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204106839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204106839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:07.790868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Terminating (SIGTERM) 20:41:07.831613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Terminating (SIGTERM) 20:41:07.872155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Terminating (SIGTERM) 20:41:07.913138 --- ParallelTerminationStrategy: PID 12979 died... 20:41:07.932654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12979): Terminated: ok {rc=0} 20:41:07.977669 --- ParallelTerminationStrategy: PID 12982 died... 20:41:07.996730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12982): Terminated: ok {rc=0} 20:41:08.041761 --- ParallelTerminationStrategy: PID 12985 died... 20:41:08.061231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12985): Terminated: ok {rc=0} 20:41:08.147227 bus /sierra_3: Setting Powered False 20:41:09.245379 bus /sierra_3: Setting Powered False 20:41:10.359375 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:41:11.505776 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:11.517837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:41:11.588021 tst mo_mt_call_osmux.py: using LAC 23590 20:41:11.713339 tst mo_mt_call_osmux.py: using RAC 130 20:41:11.839363 tst mo_mt_call_osmux.py: using CellId 23590 20:41:11.964492 tst mo_mt_call_osmux.py: using BVCI 23591 20:41:12.079369 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:12.090734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:12.102197 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:12.113637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:12.125062 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:41:12.136248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:41:12.254585 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:41:12.374607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:12.864785 run create_hlr_db(pid=12988): Launched 20:41:12.992598 bus /sierra_2: Setting Powered False 20:41:14.055456 run create_hlr_db(pid=12988): Terminated: ok {rc=0} 20:41:14.477449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Launched 20:41:14.794694 run osmo-hlr_10.42.42.2(pid=12991): Launched 20:41:14.915003 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:15.465014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Launched 20:41:15.780550 run osmo-stp_10.42.42.5(pid=12994): Launched 20:41:15.990183 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:16.689151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Launched 20:41:17.103806 run osmo-msc_10.42.42.6(pid=12997): Launched 20:41:17.459521 run osmo-stp_10.42.42.5(pid=12994): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] 20:41:17.650245 run osmo-stp_10.42.42.5(pid=12994): stdout: | (launched: 2022-12-09_20:41:15.723346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:17.786234 run osmo-stp_10.42.42.5(pid=12994): stderr: | 20221209204115917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204115918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204115918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204115919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204115919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204115919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204115919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:17.918991 run osmo-stp_10.42.42.5(pid=12994): stdout: | (launched: 2022-12-09_20:41:15.723346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:18.045530 run osmo-stp_10.42.42.5(pid=12994): stderr: | 20221209204115917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204115918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204115918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204115919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204115919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204115919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204115919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:18.197808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12994): Process ended prematurely: osmo-stp_10.42.42.5(pid=12994) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:41:18.207377 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 20:41:18.234873 run osmo-hlr_10.42.42.2(pid=12991): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12991)] 20:41:18.284024 run osmo-hlr_10.42.42.2(pid=12991): stdout: | (launched: 2022-12-09_20:41:14.737412) 20:41:18.335348 run osmo-hlr_10.42.42.2(pid=12991): stderr: | 20221209204114933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204114933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204114933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204114933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204114934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204114934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204114946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204114956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204114956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204114957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:18.406751 run osmo-msc_10.42.42.6(pid=12997): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12997)] 20:41:18.455983 run osmo-msc_10.42.42.6(pid=12997): stdout: | (launched: 2022-12-09_20:41:17.026808) 20:41:18.506743 run osmo-msc_10.42.42.6(pid=12997): stderr: | 20221209204117568 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204117569 DLGLOBAL DEBUG validating counter group 0x7fa0a7c44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204117569 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204117569 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204117569 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204117569 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204117571 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204117571 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204117571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204117571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:18.557907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Terminating (SIGTERM) 20:41:18.598900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Terminating (SIGTERM) 20:41:18.640204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Terminating (SIGTERM) 20:41:18.681478 --- ParallelTerminationStrategy: PID 12990 died... 20:41:18.701242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12990): Terminated: ok {rc=0} 20:41:18.746837 --- ParallelTerminationStrategy: PID 12993 died... 20:41:18.766171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12993): Terminated: ok {rc=0} 20:41:18.811700 --- ParallelTerminationStrategy: PID 12996 died... 20:41:18.831001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12996): Terminated: ok {rc=0} 20:41:18.915541 bus /sierra_3: Setting Powered False 20:41:20.014084 bus /sierra_3: Setting Powered False 20:41:21.128415 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:41:22.377692 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:22.384573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:41:22.417545 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:41:22.444467 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:41:22.496449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:41:22.529580 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:41:22.556659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:41:23.108458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:41:23.158958 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.170439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:41:23.241660 tst mo_mt_call.py: using LAC 23591 20:41:23.366233 tst mo_mt_call.py: using RAC 131 20:41:23.491519 tst mo_mt_call.py: using CellId 23591 20:41:23.615103 tst mo_mt_call.py: using BVCI 23592 20:41:23.729659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.741013 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.752397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.764121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.775465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:23.786725 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:23.901570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:24.015070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:24.474923 run create_hlr_db(pid=13002): Launched 20:41:24.589441 bus /sierra_2: Setting Powered False 20:41:25.649035 run create_hlr_db(pid=13002): Terminated: ok {rc=0} 20:41:26.062311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Launched 20:41:26.356640 run osmo-hlr_10.42.42.2(pid=13005): Launched 20:41:26.469796 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:26.980664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Launched 20:41:27.277540 run osmo-stp_10.42.42.5(pid=13008): Launched 20:41:27.391255 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:27.928525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13010): Launched 20:41:28.223190 run osmo-msc_10.42.42.6(pid=13011): Launched 20:41:28.389340 run osmo-stp_10.42.42.5(pid=13008): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] 20:41:28.514822 run osmo-stp_10.42.42.5(pid=13008): stdout: | (launched: 2022-12-09_20:41:27.222434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:28.640922 run osmo-stp_10.42.42.5(pid=13008): stderr: | 20221209204127392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204127392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204127392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204127393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204127393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204127393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204127393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:28.764806 run osmo-stp_10.42.42.5(pid=13008): stdout: | (launched: 2022-12-09_20:41:27.222434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:28.883381 run osmo-stp_10.42.42.5(pid=13008): stderr: | 20221209204127392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204127392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204127392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204127393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204127393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204127393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204127393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:29.025056 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13008): Process ended prematurely: osmo-stp_10.42.42.5(pid=13008) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:41:29.034041 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 20:41:29.061030 run osmo-hlr_10.42.42.2(pid=13005): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13005)] 20:41:29.107832 run osmo-hlr_10.42.42.2(pid=13005): stdout: | (launched: 2022-12-09_20:41:26.302665) 20:41:29.156746 run osmo-hlr_10.42.42.2(pid=13005): stderr: | 20221209204126479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204126479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204126479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204126479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204126479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204126479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204126492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204126500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204126501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204126501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:29.224299 run osmo-msc_10.42.42.6(pid=13011): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13011)] 20:41:29.271012 run osmo-msc_10.42.42.6(pid=13011): stdout: | (launched: 2022-12-09_20:41:28.169310) 20:41:29.319737 run osmo-msc_10.42.42.6(pid=13011): stderr: | 20221209204128438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204128438 DLGLOBAL DEBUG validating counter group 0x7fe719eb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204128438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204128438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204128439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204128439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204128441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204128442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204128442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204128442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:29.368632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Terminating (SIGTERM) 20:41:29.407782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Terminating (SIGTERM) 20:41:29.446911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13010): Terminating (SIGTERM) 20:41:29.485899 --- ParallelTerminationStrategy: PID 13004 died... 20:41:29.504811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13004): Terminated: ok {rc=0} 20:41:29.548697 --- ParallelTerminationStrategy: PID 13007 died... 20:41:29.567118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13007): Terminated: ok {rc=0} 20:41:29.610704 --- ParallelTerminationStrategy: PID 13010 died... 20:41:29.629029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13010): Terminated: ok {rc=0} 20:41:29.714003 bus /sierra_3: Setting Powered False 20:41:30.811887 bus /sierra_3: Setting Powered False 20:41:31.952621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:41:33.112090 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.124257 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:41:33.194578 tst mo_mt_call_osmux.py: using LAC 23592 20:41:33.320483 tst mo_mt_call_osmux.py: using RAC 132 20:41:33.449430 tst mo_mt_call_osmux.py: using CellId 23592 20:41:33.573350 tst mo_mt_call_osmux.py: using BVCI 23593 20:41:33.688023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.699418 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.710786 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.722063 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.733423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:41:33.744623 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:33.863674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:41:33.982403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:34.441424 run create_hlr_db(pid=13013): Launched 20:41:34.555075 bus /sierra_2: Setting Powered False 20:41:35.614573 run create_hlr_db(pid=13013): Terminated: ok {rc=0} 20:41:36.047734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Launched 20:41:36.365271 run osmo-hlr_10.42.42.2(pid=13016): Launched 20:41:36.487575 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:37.035386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Launched 20:41:37.351999 run osmo-stp_10.42.42.5(pid=13019): Launched 20:41:37.473192 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:38.049194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13021): Launched 20:41:38.366539 run osmo-msc_10.42.42.6(pid=13022): Launched 20:41:38.543790 run osmo-stp_10.42.42.5(pid=13019): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] 20:41:38.678289 run osmo-stp_10.42.42.5(pid=13019): stdout: | (launched: 2022-12-09_20:41:37.294245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:38.812209 run osmo-stp_10.42.42.5(pid=13019): stderr: | 20221209204137487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204137487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204137487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204137488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204137488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204137488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204137488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:38.945409 run osmo-stp_10.42.42.5(pid=13019): stdout: | (launched: 2022-12-09_20:41:37.294245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:39.071774 run osmo-stp_10.42.42.5(pid=13019): stderr: | 20221209204137487 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204137487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204137487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204137488 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204137488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204137488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204137488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:39.223673 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13019): Process ended prematurely: osmo-stp_10.42.42.5(pid=13019) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:41:39.233192 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:41:39.260636 run osmo-hlr_10.42.42.2(pid=13016): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13016)] 20:41:39.309745 run osmo-hlr_10.42.42.2(pid=13016): stdout: | (launched: 2022-12-09_20:41:36.307232) 20:41:39.361059 run osmo-hlr_10.42.42.2(pid=13016): stderr: | 20221209204136504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204136505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204136505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204136505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204136505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204136505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204136517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204136525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204136525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204136525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:39.431832 run osmo-msc_10.42.42.6(pid=13022): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13022)] 20:41:39.481138 run osmo-msc_10.42.42.6(pid=13022): stdout: | (launched: 2022-12-09_20:41:38.308045) 20:41:39.531686 run osmo-msc_10.42.42.6(pid=13022): stderr: | 20221209204138628 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204138628 DLGLOBAL DEBUG validating counter group 0x7fd753837c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204138629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204138629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204138629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204138629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204138631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204138631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204138631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204138631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:39.582451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Terminating (SIGTERM) 20:41:39.623069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Terminating (SIGTERM) 20:41:39.663996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13021): Terminating (SIGTERM) 20:41:39.705101 --- ParallelTerminationStrategy: PID 13015 died... 20:41:39.724653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13015): Terminated: ok {rc=0} 20:41:39.769865 --- ParallelTerminationStrategy: PID 13018 died... 20:41:39.789209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13018): Terminated: ok {rc=0} 20:41:39.834231 --- ParallelTerminationStrategy: PID 13021 died... 20:41:39.853548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13021): Terminated: ok {rc=0} 20:41:39.938658 bus /sierra_3: Setting Powered False 20:41:41.036287 bus /sierra_3: Setting Powered False 20:41:42.151320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:41:43.394407 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:41:43.402476 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:41:43.435145 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:41:43.462255 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:41:43.515521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:41:43.548537 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:41:43.575648 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:41:44.125799 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:41:44.174998 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.186646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:41:44.252689 tst mo_mt_call.py: using LAC 23593 20:41:44.377984 tst mo_mt_call.py: using RAC 133 20:41:44.502535 tst mo_mt_call.py: using CellId 23593 20:41:44.629138 tst mo_mt_call.py: using BVCI 23594 20:41:44.744005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.755635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.766979 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.778182 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.789473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:44.800578 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:44.916477 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:45.031352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:45.491968 run create_hlr_db(pid=13027): Launched 20:41:45.605917 bus /sierra_2: Setting Powered False 20:41:46.666801 run create_hlr_db(pid=13027): Terminated: ok {rc=0} 20:41:47.099551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13029): Launched 20:41:47.406542 run osmo-hlr_10.42.42.2(pid=13030): Launched 20:41:47.520468 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:48.030784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13032): Launched 20:41:48.326843 run osmo-stp_10.42.42.5(pid=13033): Launched 20:41:48.440470 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:48.977814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13035): Launched 20:41:49.273762 run osmo-msc_10.42.42.6(pid=13036): Launched 20:41:49.440210 run osmo-stp_10.42.42.5(pid=13033): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13033)] 20:41:49.566974 run osmo-stp_10.42.42.5(pid=13033): stdout: | (launched: 2022-12-09_20:41:48.272387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:49.692807 run osmo-stp_10.42.42.5(pid=13033): stderr: | 20221209204148439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204148439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204148439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204148440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204148440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204148440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204148440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:49.816369 run osmo-stp_10.42.42.5(pid=13033): stdout: | (launched: 2022-12-09_20:41:48.272387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:49.934861 run osmo-stp_10.42.42.5(pid=13033): stderr: | 20221209204148439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204148439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204148439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204148440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204148440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204148440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204148440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:50.076861 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13033): Process ended prematurely: osmo-stp_10.42.42.5(pid=13033) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13033)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:41:50.085923 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 20:41:50.112423 run osmo-hlr_10.42.42.2(pid=13030): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13030)] 20:41:50.159360 run osmo-hlr_10.42.42.2(pid=13030): stdout: | (launched: 2022-12-09_20:41:47.352590) 20:41:50.207962 run osmo-hlr_10.42.42.2(pid=13030): stderr: | 20221209204147531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204147531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204147531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204147531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204147531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204147531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204147542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204147551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204147551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204147551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:41:50.275571 run osmo-msc_10.42.42.6(pid=13036): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13036)] 20:41:50.322605 run osmo-msc_10.42.42.6(pid=13036): stdout: | (launched: 2022-12-09_20:41:49.219628) 20:41:50.371245 run osmo-msc_10.42.42.6(pid=13036): stderr: | 20221209204149489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204149489 DLGLOBAL DEBUG validating counter group 0x7fee3e3e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204149490 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204149490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204149490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204149490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204149494 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204149494 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204149495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204149495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:41:50.420266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13029): Terminating (SIGTERM) 20:41:50.459257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13032): Terminating (SIGTERM) 20:41:50.498003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13035): Terminating (SIGTERM) 20:41:50.537057 --- ParallelTerminationStrategy: PID 13029 died... 20:41:50.555552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13029): Terminated: ok {rc=0} 20:41:50.599062 --- ParallelTerminationStrategy: PID 13032 died... 20:41:50.617462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13032): Terminated: ok {rc=0} 20:41:50.661429 --- ParallelTerminationStrategy: PID 13035 died... 20:41:50.679548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13035): Terminated: ok {rc=0} 20:41:50.763854 bus /sierra_3: Setting Powered False 20:41:51.861793 bus /sierra_3: Setting Powered False 20:41:52.975530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:41:54.118950 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.130629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:41:54.198504 tst mo_mt_call_osmux.py: using LAC 23594 20:41:54.315153 tst mo_mt_call_osmux.py: using RAC 134 20:41:54.430267 tst mo_mt_call_osmux.py: using CellId 23594 20:41:54.549795 tst mo_mt_call_osmux.py: using BVCI 23595 20:41:54.666314 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.677974 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.689424 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.701409 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.713572 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:41:54.725511 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:54.840587 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:41:54.959059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:41:55.452511 run create_hlr_db(pid=13038): Launched 20:41:55.581360 bus /sierra_2: Setting Powered False 20:41:56.644271 run create_hlr_db(pid=13038): Terminated: ok {rc=0} 20:41:57.066590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Launched 20:41:57.362211 run osmo-hlr_10.42.42.2(pid=13041): Launched 20:41:57.475303 run osmo-stp_10.42.42.5: Starting osmo-stp 20:41:57.996176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Launched 20:41:58.291515 run osmo-stp_10.42.42.5(pid=13044): Launched 20:41:58.404293 run osmo-msc_10.42.42.6: Starting osmo-msc 20:41:58.940828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13046): Launched 20:41:59.235730 run osmo-msc_10.42.42.6(pid=13047): Launched 20:41:59.402071 run osmo-stp_10.42.42.5(pid=13044): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] 20:41:59.527627 run osmo-stp_10.42.42.5(pid=13044): stdout: | (launched: 2022-12-09_20:41:58.237456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:59.652802 run osmo-stp_10.42.42.5(pid=13044): stderr: | 20221209204158404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204158404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204158404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204158405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204158405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204158405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204158405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:41:59.775923 run osmo-stp_10.42.42.5(pid=13044): stdout: | (launched: 2022-12-09_20:41:58.237456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:41:59.893843 run osmo-stp_10.42.42.5(pid=13044): stderr: | 20221209204158404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204158404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204158404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204158405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204158405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204158405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204158405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:00.034592 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13044): Process ended prematurely: osmo-stp_10.42.42.5(pid=13044) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:42:00.043533 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:42:00.070189 run osmo-hlr_10.42.42.2(pid=13041): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13041)] 20:42:00.117181 run osmo-hlr_10.42.42.2(pid=13041): stdout: | (launched: 2022-12-09_20:41:57.308106) 20:42:00.165569 run osmo-hlr_10.42.42.2(pid=13041): stderr: | 20221209204157484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204157484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204157484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204157484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204157484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204157485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204157497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204157506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204157506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204157506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:00.233427 run osmo-msc_10.42.42.6(pid=13047): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13047)] 20:42:00.280130 run osmo-msc_10.42.42.6(pid=13047): stdout: | (launched: 2022-12-09_20:41:59.181776) 20:42:00.328398 run osmo-msc_10.42.42.6(pid=13047): stderr: | 20221209204159452 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204159453 DLGLOBAL DEBUG validating counter group 0x7f01c8310c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204159453 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204159453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204159453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204159453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204159455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204159455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204159455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204159456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:00.377283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Terminating (SIGTERM) 20:42:00.415968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Terminating (SIGTERM) 20:42:00.455044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13046): Terminating (SIGTERM) 20:42:00.494661 --- ParallelTerminationStrategy: PID 13040 died... 20:42:00.513709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13040): Terminated: ok {rc=0} 20:42:00.557418 --- ParallelTerminationStrategy: PID 13043 died... 20:42:00.575801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13043): Terminated: ok {rc=0} 20:42:00.619032 --- ParallelTerminationStrategy: PID 13046 died... 20:42:00.637252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13046): Terminated: ok {rc=0} 20:42:00.722078 bus /sierra_3: Setting Powered False 20:42:01.816556 bus /sierra_3: Setting Powered False 20:42:02.929028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:42:04.174613 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:04.182476 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:42:04.215084 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:42:04.242102 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:42:04.295099 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:42:04.328284 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:42:04.355815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:42:04.905927 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:42:04.956327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:04.967704 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:42:05.037156 tst mo_mt_call.py: using LAC 23595 20:42:05.161714 tst mo_mt_call.py: using RAC 135 20:42:05.286573 tst mo_mt_call.py: using CellId 23595 20:42:05.413057 tst mo_mt_call.py: using BVCI 23596 20:42:05.529946 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:05.541328 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:05.552477 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:05.563798 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:05.575032 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:05.586266 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:05.701334 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:05.818551 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:06.278905 run create_hlr_db(pid=13054): Launched 20:42:06.391677 bus /sierra_2: Setting Powered False 20:42:07.454564 run create_hlr_db(pid=13054): Terminated: ok {rc=0} 20:42:07.881328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13056): Launched 20:42:08.177437 run osmo-hlr_10.42.42.2(pid=13057): Launched 20:42:08.290605 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:08.802809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13059): Launched 20:42:09.097116 run osmo-stp_10.42.42.5(pid=13060): Launched 20:42:09.209827 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:09.744403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13062): Launched 20:42:10.040041 run osmo-msc_10.42.42.6(pid=13063): Launched 20:42:10.205915 run osmo-stp_10.42.42.5(pid=13060): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13060)] 20:42:10.331985 run osmo-stp_10.42.42.5(pid=13060): stdout: | (launched: 2022-12-09_20:42:09.043200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:10.457788 run osmo-stp_10.42.42.5(pid=13060): stderr: | 20221209204209210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204209210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204209210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204209211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204209211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204209211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204209211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:10.581447 run osmo-stp_10.42.42.5(pid=13060): stdout: | (launched: 2022-12-09_20:42:09.043200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:10.699361 run osmo-stp_10.42.42.5(pid=13060): stderr: | 20221209204209210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204209210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204209210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204209211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204209211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204209211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204209211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:10.840662 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13060): Process ended prematurely: osmo-stp_10.42.42.5(pid=13060) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13060)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:42:10.849683 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 20:42:10.875972 run osmo-hlr_10.42.42.2(pid=13057): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13057)] 20:42:10.923270 run osmo-hlr_10.42.42.2(pid=13057): stdout: | (launched: 2022-12-09_20:42:08.123182) 20:42:10.971787 run osmo-hlr_10.42.42.2(pid=13057): stderr: | 20221209204208299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204208299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204208299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204208299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204208299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204208299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204208311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204208322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204208322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204208322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:11.039425 run osmo-msc_10.42.42.6(pid=13063): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13063)] 20:42:11.086513 run osmo-msc_10.42.42.6(pid=13063): stdout: | (launched: 2022-12-09_20:42:09.985734) 20:42:11.135683 run osmo-msc_10.42.42.6(pid=13063): stderr: | 20221209204210253 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204210253 DLGLOBAL DEBUG validating counter group 0x7f0c15bcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204210253 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204210254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204210254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204210254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204210256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204210257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204210257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204210257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:11.184519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13056): Terminating (SIGTERM) 20:42:11.223286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13059): Terminating (SIGTERM) 20:42:11.262250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13062): Terminating (SIGTERM) 20:42:11.301417 --- ParallelTerminationStrategy: PID 13056 died... 20:42:11.319895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13056): Terminated: ok {rc=0} 20:42:11.363007 --- ParallelTerminationStrategy: PID 13059 died... 20:42:11.381048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13059): Terminated: ok {rc=0} 20:42:11.424004 --- ParallelTerminationStrategy: PID 13062 died... 20:42:11.442020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13062): Terminated: ok {rc=0} 20:42:11.524135 bus /sierra_3: Setting Powered False 20:42:12.621743 bus /sierra_3: Setting Powered False 20:42:13.739089 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:42:14.881694 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:14.893300 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:42:14.961790 tst mo_mt_call_osmux.py: using LAC 23596 20:42:15.078041 tst mo_mt_call_osmux.py: using RAC 136 20:42:15.196563 tst mo_mt_call_osmux.py: using CellId 23596 20:42:15.312583 tst mo_mt_call_osmux.py: using BVCI 23597 20:42:15.419691 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:15.430594 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:15.441302 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:15.452354 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:15.463425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:42:15.474449 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:15.592930 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:42:15.709557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:16.231217 run create_hlr_db(pid=13065): Launched 20:42:16.396487 bus /sierra_2: Setting Powered False 20:42:17.459679 run create_hlr_db(pid=13065): Terminated: ok {rc=0} 20:42:17.901232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13067): Launched 20:42:18.217160 run osmo-hlr_10.42.42.2(pid=13068): Launched 20:42:18.337653 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:18.886946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13070): Launched 20:42:19.201799 run osmo-stp_10.42.42.5(pid=13071): Launched 20:42:19.321822 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:19.893528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13073): Launched 20:42:20.208311 run osmo-msc_10.42.42.6(pid=13074): Launched 20:42:20.384937 run osmo-stp_10.42.42.5(pid=13071): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] 20:42:20.517970 run osmo-stp_10.42.42.5(pid=13071): stdout: | (launched: 2022-12-09_20:42:19.144593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:20.651383 run osmo-stp_10.42.42.5(pid=13071): stderr: | 20221209204219336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204219337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204219337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204219337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204219338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204219338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204219338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:20.784078 run osmo-stp_10.42.42.5(pid=13071): stdout: | (launched: 2022-12-09_20:42:19.144593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:20.910191 run osmo-stp_10.42.42.5(pid=13071): stderr: | 20221209204219336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204219337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204219337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204219337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204219338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204219338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204219338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:21.061262 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13071): Process ended prematurely: osmo-stp_10.42.42.5(pid=13071) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:42:21.070637 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:42:21.098175 run osmo-hlr_10.42.42.2(pid=13068): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13068)] 20:42:21.147054 run osmo-hlr_10.42.42.2(pid=13068): stdout: | (launched: 2022-12-09_20:42:18.159654) 20:42:21.198060 run osmo-hlr_10.42.42.2(pid=13068): stderr: | 20221209204218357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204218357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204218357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204218357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204218357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204218357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204218370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204218379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204218379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204218379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:21.269024 run osmo-msc_10.42.42.6(pid=13074): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13074)] 20:42:21.317993 run osmo-msc_10.42.42.6(pid=13074): stdout: | (launched: 2022-12-09_20:42:20.151171) 20:42:21.369055 run osmo-msc_10.42.42.6(pid=13074): stderr: | 20221209204220471 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204220471 DLGLOBAL DEBUG validating counter group 0x7f21b0463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204220471 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204220471 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204220471 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204220471 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204220473 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204220473 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204220473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204220474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:21.420048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13067): Terminating (SIGTERM) 20:42:21.460609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13070): Terminating (SIGTERM) 20:42:21.501539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13073): Terminating (SIGTERM) 20:42:21.542363 --- ParallelTerminationStrategy: PID 13067 died... 20:42:21.561604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13067): Terminated: ok {rc=0} 20:42:21.606603 --- ParallelTerminationStrategy: PID 13070 died... 20:42:21.625735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13070): Terminated: ok {rc=0} 20:42:21.670671 --- ParallelTerminationStrategy: PID 13073 died... 20:42:21.689795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13073): Terminated: ok {rc=0} 20:42:21.774414 bus /sierra_3: Setting Powered False 20:42:22.872282 bus /sierra_3: Setting Powered False 20:42:23.986325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:42:25.230348 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:25.236528 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:42:25.268835 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:42:25.294845 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:42:25.346499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:42:25.379825 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:42:25.405847 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:42:25.953609 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:42:26.007365 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.019005 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:42:26.089483 tst mo_mt_call.py: using LAC 23597 20:42:26.215069 tst mo_mt_call.py: using RAC 137 20:42:26.342578 tst mo_mt_call.py: using CellId 23597 20:42:26.469718 tst mo_mt_call.py: using BVCI 23598 20:42:26.587030 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.598733 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.610179 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.622208 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.634330 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:26.646178 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:26.761520 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:26.878265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:27.371942 run create_hlr_db(pid=13079): Launched 20:42:27.500787 bus /sierra_2: Setting Powered False 20:42:28.564011 run create_hlr_db(pid=13079): Terminated: ok {rc=0} 20:42:29.005637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13081): Launched 20:42:29.322610 run osmo-hlr_10.42.42.2(pid=13082): Launched 20:42:29.444485 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:29.988353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13084): Launched 20:42:30.304643 run osmo-stp_10.42.42.5(pid=13085): Launched 20:42:30.427246 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:31.022774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13087): Launched 20:42:31.363782 run osmo-msc_10.42.42.6(pid=13088): Launched 20:42:31.654342 run osmo-stp_10.42.42.5(pid=13085): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13085)] 20:42:31.891340 run osmo-stp_10.42.42.5(pid=13085): stdout: | (launched: 2022-12-09_20:42:30.247339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:32.108539 run osmo-stp_10.42.42.5(pid=13085): stderr: | 20221209204230440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204230440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204230440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204230441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204230441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204230441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204230441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:32.254915 run osmo-stp_10.42.42.5(pid=13085): stdout: | (launched: 2022-12-09_20:42:30.247339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:32.375726 run osmo-stp_10.42.42.5(pid=13085): stderr: | 20221209204230440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204230440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204230440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204230441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204230441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204230441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204230441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:32.517424 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13085): Process ended prematurely: osmo-stp_10.42.42.5(pid=13085) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13085)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:42:32.526586 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 20:42:32.553405 run osmo-hlr_10.42.42.2(pid=13082): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13082)] 20:42:32.600625 run osmo-hlr_10.42.42.2(pid=13082): stdout: | (launched: 2022-12-09_20:42:29.264903) 20:42:32.649841 run osmo-hlr_10.42.42.2(pid=13082): stderr: | 20221209204229460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204229461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204229461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204229461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204229461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204229461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204229472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204229482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204229482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204229482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:32.718180 run osmo-msc_10.42.42.6(pid=13088): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13088)] 20:42:32.765722 run osmo-msc_10.42.42.6(pid=13088): stdout: | (launched: 2022-12-09_20:42:31.294678) 20:42:32.814668 run osmo-msc_10.42.42.6(pid=13088): stderr: | 20221209204231820 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204231829 DLGLOBAL DEBUG validating counter group 0x7ff157f44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204231829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204231829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204231829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204231830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204231831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204231832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204231832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204231832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:32.863702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13081): Terminating (SIGTERM) 20:42:32.902913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13084): Terminating (SIGTERM) 20:42:32.942218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13087): Terminating (SIGTERM) 20:42:32.981579 --- ParallelTerminationStrategy: PID 13081 died... 20:42:33.000405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13081): Terminated: ok {rc=0} 20:42:33.044235 --- ParallelTerminationStrategy: PID 13084 died... 20:42:33.062642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13084): Terminated: ok {rc=0} 20:42:33.106317 --- ParallelTerminationStrategy: PID 13087 died... 20:42:33.124736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13087): Terminated: ok {rc=0} 20:42:33.208142 bus /sierra_3: Setting Powered False 20:42:34.304808 bus /sierra_3: Setting Powered False 20:42:35.421998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:42:36.565579 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:36.577346 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:42:36.647011 tst mo_mt_call_osmux.py: using LAC 23598 20:42:36.768280 tst mo_mt_call_osmux.py: using RAC 138 20:42:36.887069 tst mo_mt_call_osmux.py: using CellId 23598 20:42:37.003702 tst mo_mt_call_osmux.py: using BVCI 23599 20:42:37.111442 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:37.122676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:37.133649 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:37.144781 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:37.156305 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:42:37.167574 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:37.282120 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:42:37.399903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:37.893664 run create_hlr_db(pid=13090): Launched 20:42:38.024073 bus /sierra_2: Setting Powered False 20:42:39.086719 run create_hlr_db(pid=13090): Terminated: ok {rc=0} 20:42:39.512353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Launched 20:42:39.810273 run osmo-hlr_10.42.42.2(pid=13093): Launched 20:42:39.923556 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:40.445902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Launched 20:42:40.741603 run osmo-stp_10.42.42.5(pid=13096): Launched 20:42:40.855640 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:41.393278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13098): Launched 20:42:41.689370 run osmo-msc_10.42.42.6(pid=13099): Launched 20:42:41.855716 run osmo-stp_10.42.42.5(pid=13096): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] 20:42:41.982633 run osmo-stp_10.42.42.5(pid=13096): stdout: | (launched: 2022-12-09_20:42:40.687729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:42.109123 run osmo-stp_10.42.42.5(pid=13096): stderr: | 20221209204240854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204240854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204240854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204240855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204240855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204240855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204240855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:42.233269 run osmo-stp_10.42.42.5(pid=13096): stdout: | (launched: 2022-12-09_20:42:40.687729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:42.351641 run osmo-stp_10.42.42.5(pid=13096): stderr: | 20221209204240854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204240854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204240854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204240855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204240855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204240855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204240855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:42.494261 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13096): Process ended prematurely: osmo-stp_10.42.42.5(pid=13096) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:42:42.503437 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:42:42.530208 run osmo-hlr_10.42.42.2(pid=13093): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13093)] 20:42:42.577355 run osmo-hlr_10.42.42.2(pid=13093): stdout: | (launched: 2022-12-09_20:42:39.756276) 20:42:42.626206 run osmo-hlr_10.42.42.2(pid=13093): stderr: | 20221209204239930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204239930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204239930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204239930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204239930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204239930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204239943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204239952 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204239953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204239953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:42.694730 run osmo-msc_10.42.42.6(pid=13099): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13099)] 20:42:42.742077 run osmo-msc_10.42.42.6(pid=13099): stdout: | (launched: 2022-12-09_20:42:41.634911) 20:42:42.790865 run osmo-msc_10.42.42.6(pid=13099): stderr: | 20221209204241905 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204241905 DLGLOBAL DEBUG validating counter group 0x7f74b72e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204241905 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204241905 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204241905 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204241906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204241907 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204241908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204241908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204241908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:42.840258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Terminating (SIGTERM) 20:42:42.879370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Terminating (SIGTERM) 20:42:42.918408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13098): Terminating (SIGTERM) 20:42:42.957806 --- ParallelTerminationStrategy: PID 13092 died... 20:42:42.976593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13092): Terminated: ok {rc=0} 20:42:43.020469 --- ParallelTerminationStrategy: PID 13095 died... 20:42:43.038845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13095): Terminated: ok {rc=0} 20:42:43.082676 --- ParallelTerminationStrategy: PID 13098 died... 20:42:43.101142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13098): Terminated: ok {rc=0} 20:42:43.186534 bus /sierra_3: Setting Powered False 20:42:44.284058 bus /sierra_3: Setting Powered False 20:42:45.398982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:42:46.676557 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:42:46.686174 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:42:46.729986 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:42:46.763846 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:42:46.824135 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:42:46.878679 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:42:46.923313 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:42:47.437775 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:42:47.488755 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:47.500368 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:42:47.573754 tst mo_mt_call.py: using LAC 23599 20:42:47.698583 tst mo_mt_call.py: using RAC 139 20:42:47.823840 tst mo_mt_call.py: using CellId 23599 20:42:47.946460 tst mo_mt_call.py: using BVCI 23600 20:42:48.062040 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:48.073575 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:48.084692 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:48.096062 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:48.107385 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:48.118692 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:48.233380 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:48.347720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:48.806504 run create_hlr_db(pid=13104): Launched 20:42:48.920181 bus /sierra_2: Setting Powered False 20:42:49.979977 run create_hlr_db(pid=13104): Terminated: ok {rc=0} 20:42:50.414221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13106): Launched 20:42:50.730643 run osmo-hlr_10.42.42.2(pid=13107): Launched 20:42:50.853498 run osmo-stp_10.42.42.5: Starting osmo-stp 20:42:51.400551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13109): Launched 20:42:51.718260 run osmo-stp_10.42.42.5(pid=13110): Launched 20:42:51.840229 run osmo-msc_10.42.42.6: Starting osmo-msc 20:42:52.477782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13112): Launched 20:42:52.795091 run osmo-msc_10.42.42.6(pid=13113): Launched 20:42:52.972838 run osmo-stp_10.42.42.5(pid=13110): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13110)] 20:42:53.106429 run osmo-stp_10.42.42.5(pid=13110): stdout: | (launched: 2022-12-09_20:42:51.660750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:53.240451 run osmo-stp_10.42.42.5(pid=13110): stderr: | 20221209204251852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204251852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204251852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204251852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204251853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204251853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204251853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:53.374463 run osmo-stp_10.42.42.5(pid=13110): stdout: | (launched: 2022-12-09_20:42:51.660750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:42:53.501674 run osmo-stp_10.42.42.5(pid=13110): stderr: | 20221209204251852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204251852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204251852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204251852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204251853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204251853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204251853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:42:53.653472 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13110): Process ended prematurely: osmo-stp_10.42.42.5(pid=13110) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13110)] [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:42:53.663110 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:42:53.690872 run osmo-hlr_10.42.42.2(pid=13107): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13107)] 20:42:53.740452 run osmo-hlr_10.42.42.2(pid=13107): stdout: | (launched: 2022-12-09_20:42:50.673179) 20:42:53.791689 run osmo-hlr_10.42.42.2(pid=13107): stderr: | 20221209204250869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204250869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204250869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204250869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204250869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204250869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204250882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204250890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204250890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204250890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:42:53.862756 run osmo-msc_10.42.42.6(pid=13113): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13113)] 20:42:53.911625 run osmo-msc_10.42.42.6(pid=13113): stdout: | (launched: 2022-12-09_20:42:52.737617) 20:42:53.962034 run osmo-msc_10.42.42.6(pid=13113): stderr: | 20221209204253058 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204253059 DLGLOBAL DEBUG validating counter group 0x7ffb4a360c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204253059 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204253059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204253059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204253059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204253061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204253061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204253061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204253061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:42:54.013129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13106): Terminating (SIGTERM) 20:42:54.053899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13109): Terminating (SIGTERM) 20:42:54.095104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13112): Terminating (SIGTERM) 20:42:54.136443 --- ParallelTerminationStrategy: PID 13106 died... 20:42:54.155961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13106): Terminated: ok {rc=0} 20:42:54.201727 --- ParallelTerminationStrategy: PID 13109 died... 20:42:54.220906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13109): Terminated: ok {rc=0} 20:42:54.266609 --- ParallelTerminationStrategy: PID 13112 died... 20:42:54.285961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13112): Terminated: ok {rc=0} 20:42:54.373038 bus /sierra_3: Setting Powered False 20:42:55.470465 bus /sierra_3: Setting Powered False 20:42:56.586137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:42:57.734023 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:57.746268 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:42:57.818014 tst mo_mt_call_osmux.py: using LAC 23600 20:42:57.944065 tst mo_mt_call_osmux.py: using RAC 140 20:42:58.071814 tst mo_mt_call_osmux.py: using CellId 23600 20:42:58.194679 tst mo_mt_call_osmux.py: using BVCI 23601 20:42:58.309611 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:58.321190 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:58.332523 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:58.344151 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:58.355693 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:42:58.367414 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:58.483704 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:42:58.601957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:42:59.096744 run create_hlr_db(pid=13115): Launched 20:42:59.224650 bus /sierra_2: Setting Powered False 20:43:00.288196 run create_hlr_db(pid=13115): Terminated: ok {rc=0} 20:43:00.713600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13117): Launched 20:43:01.049733 run osmo-hlr_10.42.42.2(pid=13118): Launched 20:43:01.340180 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:01.962772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13120): Launched 20:43:02.319585 run osmo-stp_10.42.42.5(pid=13121): Launched 20:43:02.447157 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:02.986463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13123): Launched 20:43:03.282355 run osmo-msc_10.42.42.6(pid=13124): Launched 20:43:03.448857 run osmo-stp_10.42.42.5(pid=13121): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13121)] 20:43:03.574767 run osmo-stp_10.42.42.5(pid=13121): stdout: | (launched: 2022-12-09_20:43:02.258052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.701112 run osmo-stp_10.42.42.5(pid=13121): stderr: | 20221209204302442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204302442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204302442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204302443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204302443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204302443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204302443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:03.824498 run osmo-stp_10.42.42.5(pid=13121): stdout: | (launched: 2022-12-09_20:43:02.258052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:03.943236 run osmo-stp_10.42.42.5(pid=13121): stderr: | 20221209204302442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204302442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204302442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204302443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204302443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204302443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204302443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:04.085240 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13121): Process ended prematurely: osmo-stp_10.42.42.5(pid=13121) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13121)] [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:43:04.094340 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:43:04.120690 run osmo-hlr_10.42.42.2(pid=13118): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13118)] 20:43:04.167808 run osmo-hlr_10.42.42.2(pid=13118): stdout: | (launched: 2022-12-09_20:43:00.979394) 20:43:04.216612 run osmo-hlr_10.42.42.2(pid=13118): stderr: | 20221209204301215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204301215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204301215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204301215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204301215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204301215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204301230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204301247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204301247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204301247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:04.284364 run osmo-msc_10.42.42.6(pid=13124): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13124)] 20:43:04.331025 run osmo-msc_10.42.42.6(pid=13124): stdout: | (launched: 2022-12-09_20:43:03.228069) 20:43:04.380075 run osmo-msc_10.42.42.6(pid=13124): stderr: | 20221209204303496 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204303496 DLGLOBAL DEBUG validating counter group 0x7fde16d96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204303496 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204303496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204303496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204303497 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204303499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204303499 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204303499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204303500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:04.428929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13117): Terminating (SIGTERM) 20:43:04.468200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13120): Terminating (SIGTERM) 20:43:04.507290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13123): Terminating (SIGTERM) 20:43:04.546475 --- ParallelTerminationStrategy: PID 13117 died... 20:43:04.565189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13117): Terminated: ok {rc=0} 20:43:04.609681 --- ParallelTerminationStrategy: PID 13120 died... 20:43:04.627909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13120): Terminated: ok {rc=0} 20:43:04.671251 --- ParallelTerminationStrategy: PID 13123 died... 20:43:04.689495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13123): Terminated: ok {rc=0} 20:43:04.771633 bus /sierra_3: Setting Powered False 20:43:05.868675 bus /sierra_3: Setting Powered False 20:43:06.983041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:43:08.225459 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:08.230876 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:43:08.263226 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:43:08.289258 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:43:08.341700 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:43:08.374362 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:43:08.400411 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:43:08.947420 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:43:08.995413 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.006198 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:43:09.074248 tst mo_mt_call.py: using LAC 23601 20:43:09.192189 tst mo_mt_call.py: using RAC 141 20:43:09.308733 tst mo_mt_call.py: using CellId 23601 20:43:09.429401 tst mo_mt_call.py: using BVCI 23602 20:43:09.538160 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.548762 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.559370 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.570177 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.581068 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:09.591889 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:09.708792 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:09.824890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:10.286101 run create_hlr_db(pid=13129): Launched 20:43:10.398736 bus /sierra_2: Setting Powered False 20:43:11.458233 run create_hlr_db(pid=13129): Terminated: ok {rc=0} 20:43:11.872196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Launched 20:43:12.168120 run osmo-hlr_10.42.42.2(pid=13132): Launched 20:43:12.281321 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:12.804332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Launched 20:43:13.098445 run osmo-stp_10.42.42.5(pid=13135): Launched 20:43:13.212289 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:13.749156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13137): Launched 20:43:14.045242 run osmo-msc_10.42.42.6(pid=13138): Launched 20:43:14.211196 run osmo-stp_10.42.42.5(pid=13135): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] 20:43:14.337256 run osmo-stp_10.42.42.5(pid=13135): stdout: | (launched: 2022-12-09_20:43:13.044408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:14.463142 run osmo-stp_10.42.42.5(pid=13135): stderr: | 20221209204313213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204313213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204313213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204313214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204313214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204313214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204313214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:14.586205 run osmo-stp_10.42.42.5(pid=13135): stdout: | (launched: 2022-12-09_20:43:13.044408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:14.704184 run osmo-stp_10.42.42.5(pid=13135): stderr: | 20221209204313213 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204313213 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204313213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204313214 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204313214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204313214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204313214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:14.845188 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13135): Process ended prematurely: osmo-stp_10.42.42.5(pid=13135) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:43:14.853934 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 20:43:14.880205 run osmo-hlr_10.42.42.2(pid=13132): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13132)] 20:43:14.927343 run osmo-hlr_10.42.42.2(pid=13132): stdout: | (launched: 2022-12-09_20:43:12.113927) 20:43:14.976126 run osmo-hlr_10.42.42.2(pid=13132): stderr: | 20221209204312287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204312287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204312287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204312287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204312287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204312287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204312297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204312307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204312307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204312307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:15.044160 run osmo-msc_10.42.42.6(pid=13138): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13138)] 20:43:15.091484 run osmo-msc_10.42.42.6(pid=13138): stdout: | (launched: 2022-12-09_20:43:13.991135) 20:43:15.140612 run osmo-msc_10.42.42.6(pid=13138): stderr: | 20221209204314258 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204314258 DLGLOBAL DEBUG validating counter group 0x7f59a91d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204314258 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204314258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204314258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204314259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204314260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204314261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204314261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204314261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:15.189455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Terminating (SIGTERM) 20:43:15.228237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Terminating (SIGTERM) 20:43:15.267320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13137): Terminating (SIGTERM) 20:43:15.306799 --- ParallelTerminationStrategy: PID 13131 died... 20:43:15.325601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13131): Terminated: ok {rc=0} 20:43:15.369402 --- ParallelTerminationStrategy: PID 13134 died... 20:43:15.387837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13134): Terminated: ok {rc=0} 20:43:15.432060 --- ParallelTerminationStrategy: PID 13137 died... 20:43:15.450498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13137): Terminated: ok {rc=0} 20:43:15.533753 bus /sierra_3: Setting Powered False 20:43:16.638655 bus /sierra_3: Setting Powered False 20:43:17.773660 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:43:18.917957 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:18.929339 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:43:18.998111 tst mo_mt_call_osmux.py: using LAC 23602 20:43:19.116319 tst mo_mt_call_osmux.py: using RAC 142 20:43:19.233033 tst mo_mt_call_osmux.py: using CellId 23602 20:43:19.348384 tst mo_mt_call_osmux.py: using BVCI 23603 20:43:19.455613 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:19.466478 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:19.477134 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:19.487916 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:19.498808 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:43:19.509721 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:19.625474 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:43:19.744042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:20.238264 run create_hlr_db(pid=13140): Launched 20:43:20.367931 bus /sierra_2: Setting Powered False 20:43:21.430904 run create_hlr_db(pid=13140): Terminated: ok {rc=0} 20:43:21.855494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13142): Launched 20:43:22.151712 run osmo-hlr_10.42.42.2(pid=13143): Launched 20:43:22.264614 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:22.776915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13145): Launched 20:43:23.073363 run osmo-stp_10.42.42.5(pid=13146): Launched 20:43:23.186443 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:23.727668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13148): Launched 20:43:24.024749 run osmo-msc_10.42.42.6(pid=13149): Launched 20:43:24.190621 run osmo-stp_10.42.42.5(pid=13146): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13146)] 20:43:24.317155 run osmo-stp_10.42.42.5(pid=13146): stdout: | (launched: 2022-12-09_20:43:23.018811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:24.443639 run osmo-stp_10.42.42.5(pid=13146): stderr: | 20221209204323188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204323188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204323188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204323189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204323189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204323189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204323189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:24.567381 run osmo-stp_10.42.42.5(pid=13146): stdout: | (launched: 2022-12-09_20:43:23.018811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:24.686170 run osmo-stp_10.42.42.5(pid=13146): stderr: | 20221209204323188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204323188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204323188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204323189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204323189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204323189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204323189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:24.828352 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13146): Process ended prematurely: osmo-stp_10.42.42.5(pid=13146) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13146)] [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:43:24.837209 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:43:24.864037 run osmo-hlr_10.42.42.2(pid=13143): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13143)] 20:43:24.910956 run osmo-hlr_10.42.42.2(pid=13143): stdout: | (launched: 2022-12-09_20:43:22.097802) 20:43:24.959649 run osmo-hlr_10.42.42.2(pid=13143): stderr: | 20221209204322272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204322272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204322272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204322272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204322272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204322272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204322289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204322299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204322299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204322299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:25.027591 run osmo-msc_10.42.42.6(pid=13149): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13149)] 20:43:25.074695 run osmo-msc_10.42.42.6(pid=13149): stdout: | (launched: 2022-12-09_20:43:23.970487) 20:43:25.123441 run osmo-msc_10.42.42.6(pid=13149): stderr: | 20221209204324238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204324238 DLGLOBAL DEBUG validating counter group 0x7f507efe2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204324238 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204324238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204324238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204324239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204324240 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204324241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204324241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204324241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:25.173186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13142): Terminating (SIGTERM) 20:43:25.212492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13145): Terminating (SIGTERM) 20:43:25.251520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13148): Terminating (SIGTERM) 20:43:25.290772 --- ParallelTerminationStrategy: PID 13142 died... 20:43:25.309563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13142): Terminated: ok {rc=0} 20:43:25.353367 --- ParallelTerminationStrategy: PID 13145 died... 20:43:25.371582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13145): Terminated: ok {rc=0} 20:43:25.415498 --- ParallelTerminationStrategy: PID 13148 died... 20:43:25.433884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13148): Terminated: ok {rc=0} 20:43:25.519131 bus /sierra_3: Setting Powered False 20:43:26.619528 bus /sierra_3: Setting Powered False 20:43:27.733675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:43:28.976092 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:28.982008 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:43:29.014234 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 20:43:29.040295 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 20:43:29.092782 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:43:29.125346 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 20:43:29.151281 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 20:43:29.700304 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 20:43:29.748424 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:29.759578 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:43:29.809727 tst mo_mt_call.py: using LAC 23603 20:43:29.936807 tst mo_mt_call.py: using RAC 143 20:43:30.062224 tst mo_mt_call.py: using CellId 23603 20:43:30.188701 tst mo_mt_call.py: using BVCI 23604 20:43:30.304534 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.316345 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.327836 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.339675 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.351208 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:30.362613 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:30.478977 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:30.598882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:31.118795 run create_hlr_db(pid=13155): Launched 20:43:31.275453 bus /sierra_2: Setting Powered False 20:43:32.335720 run create_hlr_db(pid=13155): Terminated: ok {rc=0} 20:43:32.780481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13157): Launched 20:43:33.098441 run osmo-hlr_10.42.42.2(pid=13158): Launched 20:43:33.219461 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:33.773585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13160): Launched 20:43:34.090860 run osmo-stp_10.42.42.5(pid=13161): Launched 20:43:34.212044 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:34.787273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13163): Launched 20:43:35.104938 run osmo-msc_10.42.42.6(pid=13164): Launched 20:43:35.274350 run osmo-stp_10.42.42.5(pid=13161): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13161)] 20:43:35.403270 run osmo-stp_10.42.42.5(pid=13161): stdout: | (launched: 2022-12-09_20:43:34.033090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:35.528928 run osmo-stp_10.42.42.5(pid=13161): stderr: | 20221209204334224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204334224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204334224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204334225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204334225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204334225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204334225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:35.652892 run osmo-stp_10.42.42.5(pid=13161): stdout: | (launched: 2022-12-09_20:43:34.033090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:35.770905 run osmo-stp_10.42.42.5(pid=13161): stderr: | 20221209204334224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204334224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204334224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204334225 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204334225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204334225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204334225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:35.912571 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13161): Process ended prematurely: osmo-stp_10.42.42.5(pid=13161) [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13161)] [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 20:43:35.921512 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:43:35.947687 run osmo-hlr_10.42.42.2(pid=13158): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13158)] 20:43:35.994775 run osmo-hlr_10.42.42.2(pid=13158): stdout: | (launched: 2022-12-09_20:43:33.040482) 20:43:36.043520 run osmo-hlr_10.42.42.2(pid=13158): stderr: | 20221209204333241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204333241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204333241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204333241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204333241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204333241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204333254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204333264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204333264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204333264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:36.111178 run osmo-msc_10.42.42.6(pid=13164): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13164)] 20:43:36.157926 run osmo-msc_10.42.42.6(pid=13164): stdout: | (launched: 2022-12-09_20:43:35.047098) 20:43:36.206258 run osmo-msc_10.42.42.6(pid=13164): stderr: | 20221209204335317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204335317 DLGLOBAL DEBUG validating counter group 0x7fc8be283c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204335317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204335317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204335317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204335317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204335319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204335319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204335320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204335320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:36.255140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13157): Terminating (SIGTERM) 20:43:36.294060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13160): Terminating (SIGTERM) 20:43:36.333064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13163): Terminating (SIGTERM) 20:43:36.372220 --- ParallelTerminationStrategy: PID 13157 died... 20:43:36.390954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13157): Terminated: ok {rc=0} 20:43:36.434811 --- ParallelTerminationStrategy: PID 13160 died... 20:43:36.452866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13160): Terminated: ok {rc=0} 20:43:36.496380 --- ParallelTerminationStrategy: PID 13163 died... 20:43:36.514665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13163): Terminated: ok {rc=0} 20:43:36.597170 bus /sierra_3: Setting Powered False 20:43:37.694063 bus /sierra_3: Setting Powered False 20:43:38.811473 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 20:43:39.959772 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:39.971990 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:43:40.024445 tst mo_mt_call_osmux.py: using LAC 23604 20:43:40.143572 tst mo_mt_call_osmux.py: using RAC 144 20:43:40.269156 tst mo_mt_call_osmux.py: using CellId 23604 20:43:40.394427 tst mo_mt_call_osmux.py: using BVCI 23605 20:43:40.511667 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:40.523590 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:40.535129 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:40.546775 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:40.558314 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 20:43:40.569760 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:40.684268 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 20:43:40.803484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:41.298041 run create_hlr_db(pid=13166): Launched 20:43:41.427651 bus /sierra_2: Setting Powered False 20:43:42.490483 run create_hlr_db(pid=13166): Terminated: ok {rc=0} 20:43:42.916650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Launched 20:43:43.214523 run osmo-hlr_10.42.42.2(pid=13169): Launched 20:43:43.328292 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:43.839209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Launched 20:43:44.135142 run osmo-stp_10.42.42.5(pid=13172): Launched 20:43:44.248458 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:44.785655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Launched 20:43:45.083433 run osmo-msc_10.42.42.6(pid=13175): Launched 20:43:45.249776 run osmo-stp_10.42.42.5(pid=13172): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] 20:43:45.376733 run osmo-stp_10.42.42.5(pid=13172): stdout: | (launched: 2022-12-09_20:43:44.081149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:45.503499 run osmo-stp_10.42.42.5(pid=13172): stderr: | 20221209204344249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204344249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204344249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204344250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204344250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204344250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204344250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:45.627652 run osmo-stp_10.42.42.5(pid=13172): stdout: | (launched: 2022-12-09_20:43:44.081149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:45.746585 run osmo-stp_10.42.42.5(pid=13172): stderr: | 20221209204344249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204344249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204344249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204344250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204344250 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204344250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204344250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:45.906539 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13172): Process ended prematurely: osmo-stp_10.42.42.5(pid=13172) [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 20:43:45.915965 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:43:45.944815 run osmo-hlr_10.42.42.2(pid=13169): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13169)] 20:43:45.994008 run osmo-hlr_10.42.42.2(pid=13169): stdout: | (launched: 2022-12-09_20:43:43.159991) 20:43:46.045082 run osmo-hlr_10.42.42.2(pid=13169): stderr: | 20221209204343337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204343337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204343337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204343337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204343337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204343337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204343349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204343358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204343358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204343358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:46.115680 run osmo-msc_10.42.42.6(pid=13175): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13175)] 20:43:46.164888 run osmo-msc_10.42.42.6(pid=13175): stdout: | (launched: 2022-12-09_20:43:45.029119) 20:43:46.215832 run osmo-msc_10.42.42.6(pid=13175): stderr: | 20221209204345298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204345298 DLGLOBAL DEBUG validating counter group 0x7f274eec1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204345298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204345298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204345298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204345299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204345302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204345303 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204345303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204345303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:46.267376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Terminating (SIGTERM) 20:43:46.308898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Terminating (SIGTERM) 20:43:46.349994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Terminating (SIGTERM) 20:43:46.391468 --- ParallelTerminationStrategy: PID 13168 died... 20:43:46.410900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Terminated: ok {rc=0} 20:43:46.457409 --- ParallelTerminationStrategy: PID 13171 died... 20:43:46.476457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Terminated: ok {rc=0} 20:43:46.523137 --- ParallelTerminationStrategy: PID 13174 died... 20:43:46.542370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Terminated: ok {rc=0} 20:43:46.629207 bus /sierra_3: Setting Powered False 20:43:47.725607 bus /sierra_3: Setting Powered False 20:43:48.839183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:trx-umtrx --------------------------------------------------------------------- 20:43:50.083437 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:43:50.087711 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:43:50.120058 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:43:50.146064 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 20:43:50.228347 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:43:50.260490 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:43:50.286784 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 20:43:50.868789 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 20:43:50.873730 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:50.884122 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 20:43:50.930979 tst emergency_mo_mt_call.py: using LAC 23605 20:43:51.044686 tst emergency_mo_mt_call.py: using RAC 145 20:43:51.158810 tst emergency_mo_mt_call.py: using CellId 23605 20:43:51.277472 tst emergency_mo_mt_call.py: using BVCI 23606 20:43:51.393669 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.404690 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.415749 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.426510 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.437554 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:43:51.448465 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:51.561610 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:43:51.680061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:43:52.168039 run create_hlr_db(pid=13180): Launched 20:43:52.295666 bus /sierra_2: Setting Powered False 20:43:53.357749 run create_hlr_db(pid=13180): Terminated: ok {rc=0} 20:43:53.796311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Launched 20:43:54.109626 run osmo-hlr_10.42.42.2(pid=13183): Launched 20:43:54.229549 run osmo-stp_10.42.42.5: Starting osmo-stp 20:43:54.775001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Launched 20:43:55.088063 run osmo-stp_10.42.42.5(pid=13186): Launched 20:43:55.217469 tst emergency_mo_mt_call.py: using MSISDN 7370 20:43:55.378495 run osmo-msc_10.42.42.6: Starting osmo-msc 20:43:55.944445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13188): Launched 20:43:56.257767 run osmo-msc_10.42.42.6(pid=13189): Launched 20:43:56.432824 run osmo-stp_10.42.42.5(pid=13186): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] 20:43:56.565398 run osmo-stp_10.42.42.5(pid=13186): stdout: | (launched: 2022-12-09_20:43:55.031000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:56.698636 run osmo-stp_10.42.42.5(pid=13186): stderr: | 20221209204355221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204355222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204355222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204355222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204355223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204355223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204355223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:56.830486 run osmo-stp_10.42.42.5(pid=13186): stdout: | (launched: 2022-12-09_20:43:55.031000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:43:56.955838 run osmo-stp_10.42.42.5(pid=13186): stderr: | 20221209204355221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204355222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204355222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204355222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204355223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204355223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204355223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:43:57.105910 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13186): Process ended prematurely: osmo-stp_10.42.42.5(pid=13186) [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 20:43:57.115072 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 20:43:57.142458 run osmo-hlr_10.42.42.2(pid=13183): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13183)] 20:43:57.191712 run osmo-hlr_10.42.42.2(pid=13183): stdout: | (launched: 2022-12-09_20:43:54.052417) 20:43:57.242521 run osmo-hlr_10.42.42.2(pid=13183): stderr: | 20221209204354247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204354247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204354247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204354247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204354247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204354247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204354259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204354268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204354268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204354268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:43:57.313196 run osmo-msc_10.42.42.6(pid=13189): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13189)] 20:43:57.363765 run osmo-msc_10.42.42.6(pid=13189): stdout: | (launched: 2022-12-09_20:43:56.200849) 20:43:57.414791 run osmo-msc_10.42.42.6(pid=13189): stderr: | 20221209204356520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204356520 DLGLOBAL DEBUG validating counter group 0x7f047017cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204356520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204356520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204356521 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204356521 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204356523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204356523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204356523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204356524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:43:57.465981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Terminating (SIGTERM) 20:43:57.506711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Terminating (SIGTERM) 20:43:57.547582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13188): Terminating (SIGTERM) 20:43:57.589117 --- ParallelTerminationStrategy: PID 13182 died... 20:43:57.608738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13182): Terminated: ok {rc=0} 20:43:57.653958 --- ParallelTerminationStrategy: PID 13185 died... 20:43:57.673272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13185): Terminated: ok {rc=0} 20:43:57.718212 --- ParallelTerminationStrategy: PID 13188 died... 20:43:57.737358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13188): Terminated: ok {rc=0} 20:43:57.823859 bus /sierra_3: Setting Powered False 20:43:58.921928 bus /sierra_3: Setting Powered False 20:44:00.037660 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 20:44:01.123182 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.135669 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:01.193237 tst emergency_preemptive_call.py: using LAC 23606 20:44:01.324583 tst emergency_preemptive_call.py: using RAC 146 20:44:01.451715 tst emergency_preemptive_call.py: using CellId 23606 20:44:01.581831 tst emergency_preemptive_call.py: using BVCI 23607 20:44:01.698951 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.711524 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.722822 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.734274 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.745908 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 20:44:01.757788 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:01.881248 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:02.006563 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:02.133645 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:02.253930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:02.742262 run create_hlr_db(pid=13191): Launched 20:44:02.869302 bus /sierra_2: Setting Powered False 20:44:03.931620 run create_hlr_db(pid=13191): Terminated: ok {rc=0} 20:44:04.350293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Launched 20:44:04.643133 run osmo-hlr_10.42.42.2(pid=13194): Launched 20:44:04.755836 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:05.273881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Launched 20:44:05.565958 run osmo-stp_10.42.42.5(pid=13197): Launched 20:44:05.686753 tst emergency_preemptive_call.py: using MSISDN 7371 20:44:05.838036 run osmo-msc_10.42.42.6: Starting osmo-msc 20:44:06.361405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Launched 20:44:06.652856 run osmo-msc_10.42.42.6(pid=13200): Launched 20:44:06.816287 run osmo-stp_10.42.42.5(pid=13197): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] 20:44:06.940605 run osmo-stp_10.42.42.5(pid=13197): stdout: | (launched: 2022-12-09_20:44:05.512497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:07.065889 run osmo-stp_10.42.42.5(pid=13197): stderr: | 20221209204405682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204405682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204405683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204405683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204405684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204405684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204405684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:07.188316 run osmo-stp_10.42.42.5(pid=13197): stdout: | (launched: 2022-12-09_20:44:05.512497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:07.304613 run osmo-stp_10.42.42.5(pid=13197): stderr: | 20221209204405682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204405682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204405683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204405683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204405684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204405684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204405684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:07.444604 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13197): Process ended prematurely: osmo-stp_10.42.42.5(pid=13197) [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 20:44:07.453184 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 20:44:07.479416 run osmo-hlr_10.42.42.2(pid=13194): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13194)] 20:44:07.527030 run osmo-hlr_10.42.42.2(pid=13194): stdout: | (launched: 2022-12-09_20:44:04.589623) 20:44:07.575331 run osmo-hlr_10.42.42.2(pid=13194): stderr: | 20221209204404765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204404766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204404766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204404766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204404766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204404766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204404779 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204404789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204404789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204404789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:07.643431 run osmo-msc_10.42.42.6(pid=13200): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13200)] 20:44:07.690162 run osmo-msc_10.42.42.6(pid=13200): stdout: | (launched: 2022-12-09_20:44:06.599198) 20:44:07.738695 run osmo-msc_10.42.42.6(pid=13200): stderr: | 20221209204406870 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204406870 DLGLOBAL DEBUG validating counter group 0x7f6abaae4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204406870 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204406870 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204406870 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204406870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204406872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204406873 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204406873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204406873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:44:07.787542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Terminating (SIGTERM) 20:44:07.826551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Terminating (SIGTERM) 20:44:07.865494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Terminating (SIGTERM) 20:44:07.904476 --- ParallelTerminationStrategy: PID 13193 died... 20:44:07.923227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Terminated: ok {rc=0} 20:44:07.967256 --- ParallelTerminationStrategy: PID 13196 died... 20:44:07.985540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Terminated: ok {rc=0} 20:44:08.029069 --- ParallelTerminationStrategy: PID 13199 died... 20:44:08.047186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Terminated: ok {rc=0} 20:44:08.130447 bus /sierra_9: Setting Powered False 20:44:09.229176 bus /sierra_9: Setting Powered False 20:44:10.342226 bus /sierra_8: Setting Powered False 20:44:11.434055 bus /sierra_8: Setting Powered False 20:44:12.547527 bus /sierra_3: Setting Powered False 20:44:13.645364 bus /sierra_3: Setting Powered False 20:44:14.757988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx --------------------------------------------------------------------- 20:44:16.073266 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:44:16.078250 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 20:44:16.114091 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 20:44:16.154286 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 20:44:16.241855 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 20:44:16.294309 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 20:44:16.342461 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 20:44:16.903204 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 20:44:16.963388 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:16.974919 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:17.023700 tst cs_paging_gprs_active.py: using LAC 23607 20:44:17.150764 tst cs_paging_gprs_active.py: using RAC 147 20:44:17.303129 tst cs_paging_gprs_active.py: using CellId 23607 20:44:17.428524 tst cs_paging_gprs_active.py: using BVCI 23608 20:44:17.545093 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.556012 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.566762 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.578223 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.589751 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.601427 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.612668 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.623900 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:17.635259 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:17.751925 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:17.870930 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:44:18.088529 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:18.409750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13206): Launched 20:44:18.687409 run iperf3-srv_10.42.42.10(pid=13207): Launched 20:44:18.807428 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:44:19.023557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:19.345835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Launched 20:44:19.623326 run iperf3-srv_10.42.42.10(pid=13209): Launched 20:44:19.743154 tst cs_paging_gprs_active.py:38: start network... 20:44:19.959290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:20.456446 run create_hlr_db(pid=13210): Launched 20:44:20.586252 bus /sierra_2: Setting Powered False 20:44:21.649982 run create_hlr_db(pid=13210): Terminated: ok {rc=0} 20:44:22.073744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Launched 20:44:22.371954 run osmo-hlr_10.42.42.2(pid=13213): Launched 20:44:22.486034 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:23.010180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Launched 20:44:23.308142 run osmo-stp_10.42.42.5(pid=13216): Launched 20:44:23.421391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:23.935706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Launched 20:44:24.049172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:24.300675 run patchelf(pid=13219): Launched 20:44:24.466920 run osmo-stp_10.42.42.5(pid=13216): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] 20:44:24.593408 run osmo-stp_10.42.42.5(pid=13216): stdout: | (launched: 2022-12-09_20:44:23.252913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:24.721468 run osmo-stp_10.42.42.5(pid=13216): stderr: | 20221209204423419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204423419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204423419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204423420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204423420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204423420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204423420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:24.849949 run osmo-stp_10.42.42.5(pid=13216): stdout: | (launched: 2022-12-09_20:44:23.252913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:24.972163 run osmo-stp_10.42.42.5(pid=13216): stderr: | 20221209204423419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204423419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204423419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204423420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204423420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204423420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204423420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:25.116667 run patchelf(pid=13219): Terminating (SIGINT) 20:44:25.285897 run patchelf(pid=13219): Terminated: ok {rc=0} 20:44:25.407009 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13216): Process ended prematurely: osmo-stp_10.42.42.5(pid=13216) [trial-2364↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] [trial-2364↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 20:44:25.416374 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 20:44:25.443760 run osmo-hlr_10.42.42.2(pid=13213): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13213)] 20:44:25.490768 run osmo-hlr_10.42.42.2(pid=13213): stdout: | (launched: 2022-12-09_20:44:22.317303) 20:44:25.539661 run osmo-hlr_10.42.42.2(pid=13213): stderr: | 20221209204422490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204422490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204422491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204422491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204422491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204422491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204422503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204422512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204422512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204422512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:25.588754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13206): Terminating (SIGTERM) 20:44:25.627955 run iperf3-srv_10.42.42.10(pid=13207): Terminating (SIGTERM) 20:44:25.667243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Terminating (SIGTERM) 20:44:25.706122 run iperf3-srv_10.42.42.10(pid=13209): Terminating (SIGTERM) 20:44:25.744925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Terminating (SIGTERM) 20:44:25.783670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Terminating (SIGTERM) 20:44:25.822764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Terminating (SIGTERM) 20:44:25.862380 --- ParallelTerminationStrategy: PID 13206 died... 20:44:25.881227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13206): Terminated: ok {rc=0} 20:44:25.925116 --- ParallelTerminationStrategy: PID 13207 died... 20:44:25.943559 run iperf3-srv_10.42.42.10(pid=13207): Terminated {rc=256} 20:44:25.986795 --- ParallelTerminationStrategy: PID 13208 died... 20:44:26.005105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13208): Terminated: ok {rc=0} 20:44:26.048700 --- ParallelTerminationStrategy: PID 13209 died... 20:44:26.067164 run iperf3-srv_10.42.42.10(pid=13209): Terminated {rc=256} 20:44:26.110811 --- ParallelTerminationStrategy: PID 13212 died... 20:44:26.129091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13212): Terminated: ok {rc=0} 20:44:26.172737 --- ParallelTerminationStrategy: PID 13215 died... 20:44:26.191095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13215): Terminated: ok {rc=0} 20:44:26.234855 --- ParallelTerminationStrategy: PID 13218 died... 20:44:26.253417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13218): Terminated: ok {rc=0} 20:44:26.336369 bus /gobi_0: Setting Powered False 20:44:27.433443 bus /gobi_0: Setting Powered False 20:44:28.549645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx iperf3.py ---------------------------------------------- 20:44:29.696875 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:29.708452 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:29.760336 tst iperf3.py: using LAC 23608 20:44:29.885100 tst iperf3.py: using RAC 148 20:44:30.009775 tst iperf3.py: using CellId 23608 20:44:30.138302 tst iperf3.py: using BVCI 23609 20:44:30.255590 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.266602 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.277342 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.288069 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.298720 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.309368 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.320212 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.331011 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:30.341950 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:30.459774 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:30.676096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:31.009904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13220): Launched 20:44:31.299797 run iperf3-srv_10.42.42.10(pid=13221): Launched 20:44:31.434443 tst iperf3.py:8: start network... 20:44:31.654781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:32.170313 run create_hlr_db(pid=13222): Launched 20:44:32.300846 bus /gobi_6: Setting Powered False 20:44:33.363166 run create_hlr_db(pid=13222): Terminated: ok {rc=0} 20:44:33.790078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13224): Launched 20:44:34.088520 run osmo-hlr_10.42.42.2(pid=13225): Launched 20:44:34.203161 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:34.756529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13227): Launched 20:44:35.074091 run osmo-stp_10.42.42.5(pid=13228): Launched 20:44:35.194634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:35.744623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13230): Launched 20:44:35.866263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:36.134959 run patchelf(pid=13231): Launched 20:44:36.312312 run osmo-stp_10.42.42.5(pid=13228): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13228)] 20:44:36.447781 run osmo-stp_10.42.42.5(pid=13228): stdout: | (launched: 2022-12-09_20:44:35.016210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:36.584112 run osmo-stp_10.42.42.5(pid=13228): stderr: | 20221209204435207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204435207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204435207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204435207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204435208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204435208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204435208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:36.720913 run osmo-stp_10.42.42.5(pid=13228): stdout: | (launched: 2022-12-09_20:44:35.016210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:36.851516 run osmo-stp_10.42.42.5(pid=13228): stderr: | 20221209204435207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204435207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204435207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204435207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204435208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204435208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204435208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:37.006743 run patchelf(pid=13231): Terminating (SIGINT) 20:44:37.185672 run patchelf(pid=13231): Terminated: ok {rc=0} 20:44:37.314527 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13228): Process ended prematurely: osmo-stp_10.42.42.5(pid=13228) [trial-2364↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13228)] [trial-2364↪gprs:trx-umtrx↪iperf3.py:8] 20:44:37.324592 tst iperf3.py:8: Test FAILED (7.7 sec) 20:44:37.352713 run osmo-hlr_10.42.42.2(pid=13225): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13225)] 20:44:37.401517 run osmo-hlr_10.42.42.2(pid=13225): stdout: | (launched: 2022-12-09_20:44:34.033794) 20:44:37.452187 run osmo-hlr_10.42.42.2(pid=13225): stderr: | 20221209204434208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204434208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204434208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204434208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204434208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204434208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204434220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204434229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204434229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204434229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:37.503252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13220): Terminating (SIGTERM) 20:44:37.544091 run iperf3-srv_10.42.42.10(pid=13221): Terminating (SIGTERM) 20:44:37.584918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13224): Terminating (SIGTERM) 20:44:37.625978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13227): Terminating (SIGTERM) 20:44:37.666701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13230): Terminating (SIGTERM) 20:44:37.707948 --- ParallelTerminationStrategy: PID 13220 died... 20:44:37.727499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13220): Terminated: ok {rc=0} 20:44:37.773128 --- ParallelTerminationStrategy: PID 13221 died... 20:44:37.792258 run iperf3-srv_10.42.42.10(pid=13221): Terminated {rc=256} 20:44:37.837171 --- ParallelTerminationStrategy: PID 13224 died... 20:44:37.856331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13224): Terminated: ok {rc=0} 20:44:37.901364 --- ParallelTerminationStrategy: PID 13227 died... 20:44:37.920485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13227): Terminated: ok {rc=0} 20:44:37.965574 --- ParallelTerminationStrategy: PID 13230 died... 20:44:37.984768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13230): Terminated: ok {rc=0} 20:44:38.069627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 20:44:39.220537 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.232212 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:39.279831 tst iperf3m4.py: using LAC 23609 20:44:39.408272 tst iperf3m4.py: using RAC 149 20:44:39.534225 tst iperf3m4.py: using CellId 23609 20:44:39.658040 tst iperf3m4.py: using BVCI 23610 20:44:39.774654 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.785710 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.796431 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.807213 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.817994 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.828527 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.839341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.850008 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:39.861001 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:39.976701 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:40.102694 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:40.216813 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:40.335714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:44:40.553691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:40.875107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13232): Launched 20:44:41.153169 run iperf3-srv_10.42.42.10(pid=13233): Launched 20:44:41.272778 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:44:41.488676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:41.809284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13234): Launched 20:44:42.086687 run iperf3-srv_10.42.42.10(pid=13235): Launched 20:44:42.205849 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:44:42.420854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:42.741653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13236): Launched 20:44:43.019637 run iperf3-srv_10.42.42.10(pid=13237): Launched 20:44:43.139532 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:44:43.355329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:44:43.676794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Launched 20:44:43.955074 run iperf3-srv_10.42.42.10(pid=13239): Launched 20:44:44.074504 tst iperf3m4.py:8: start network... 20:44:44.289701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:44:44.786844 run create_hlr_db(pid=13240): Launched 20:44:44.916931 bus /gobi_6: Setting Powered False 20:44:45.978535 run create_hlr_db(pid=13240): Terminated: ok {rc=0} 20:44:46.438148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Launched 20:44:46.782659 run osmo-hlr_10.42.42.2(pid=13243): Launched 20:44:46.968084 run osmo-stp_10.42.42.5: Starting osmo-stp 20:44:47.622288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Launched 20:44:47.928855 run osmo-stp_10.42.42.5(pid=13246): Launched 20:44:48.044670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:44:48.568503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Launched 20:44:48.684692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:44:48.942281 run patchelf(pid=13249): Launched 20:44:49.110491 run osmo-stp_10.42.42.5(pid=13246): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] 20:44:49.239038 run osmo-stp_10.42.42.5(pid=13246): stdout: | (launched: 2022-12-09_20:44:47.872675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:49.369088 run osmo-stp_10.42.42.5(pid=13246): stderr: | 20221209204448039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204448039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204448039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204448040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204448040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204448040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204448040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:49.499142 run osmo-stp_10.42.42.5(pid=13246): stdout: | (launched: 2022-12-09_20:44:47.872675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:44:49.623687 run osmo-stp_10.42.42.5(pid=13246): stderr: | 20221209204448039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204448039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204448039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204448040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204448040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204448040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204448040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:44:49.771108 run patchelf(pid=13249): Terminating (SIGINT) 20:44:49.942308 run patchelf(pid=13249): Terminated: ok {rc=0} 20:44:50.065257 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13246): Process ended prematurely: osmo-stp_10.42.42.5(pid=13246) [trial-2364↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] [trial-2364↪gprs:trx-umtrx↪iperf3m4.py:8] 20:44:50.074762 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:44:50.102771 run osmo-hlr_10.42.42.2(pid=13243): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13243)] 20:44:50.150673 run osmo-hlr_10.42.42.2(pid=13243): stdout: | (launched: 2022-12-09_20:44:46.709428) 20:44:50.200099 run osmo-hlr_10.42.42.2(pid=13243): stderr: | 20221209204447083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204447084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204447084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204447084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204447084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204447084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204447103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204447115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204447116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204447116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:44:50.249941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13232): Terminating (SIGTERM) 20:44:50.289607 run iperf3-srv_10.42.42.10(pid=13233): Terminating (SIGTERM) 20:44:50.329132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13234): Terminating (SIGTERM) 20:44:50.368730 run iperf3-srv_10.42.42.10(pid=13235): Terminating (SIGTERM) 20:44:50.408177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13236): Terminating (SIGTERM) 20:44:50.447652 run iperf3-srv_10.42.42.10(pid=13237): Terminating (SIGTERM) 20:44:50.486786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Terminating (SIGTERM) 20:44:50.526029 run iperf3-srv_10.42.42.10(pid=13239): Terminating (SIGTERM) 20:44:50.564919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Terminating (SIGTERM) 20:44:50.604605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Terminating (SIGTERM) 20:44:50.643675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Terminating (SIGTERM) 20:44:50.683091 --- ParallelTerminationStrategy: PID 13232 died... 20:44:50.701997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13232): Terminated: ok {rc=0} 20:44:50.745976 --- ParallelTerminationStrategy: PID 13233 died... 20:44:50.764269 run iperf3-srv_10.42.42.10(pid=13233): Terminated {rc=256} 20:44:50.809457 --- ParallelTerminationStrategy: PID 13234 died... 20:44:50.827895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13234): Terminated: ok {rc=0} 20:44:50.871974 --- ParallelTerminationStrategy: PID 13235 died... 20:44:50.890434 run iperf3-srv_10.42.42.10(pid=13235): Terminated {rc=256} 20:44:50.934306 --- ParallelTerminationStrategy: PID 13236 died... 20:44:50.952764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13236): Terminated: ok {rc=0} 20:44:50.997419 --- ParallelTerminationStrategy: PID 13237 died... 20:44:51.015851 run iperf3-srv_10.42.42.10(pid=13237): Terminated {rc=256} 20:44:51.059943 --- ParallelTerminationStrategy: PID 13238 died... 20:44:51.078484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13238): Terminated: ok {rc=0} 20:44:51.122559 --- ParallelTerminationStrategy: PID 13239 died... 20:44:51.141040 run iperf3-srv_10.42.42.10(pid=13239): Terminated {rc=256} 20:44:51.185176 --- ParallelTerminationStrategy: PID 13242 died... 20:44:51.203680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13242): Terminated: ok {rc=0} 20:44:51.247639 --- ParallelTerminationStrategy: PID 13245 died... 20:44:51.266250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13245): Terminated: ok {rc=0} 20:44:51.310526 --- ParallelTerminationStrategy: PID 13248 died... 20:44:51.329116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13248): Terminated: ok {rc=0} 20:44:51.414752 bus /gobi_4: Setting Powered False 20:44:52.513956 bus /gobi_4: Setting Powered False 20:44:53.628615 bus /gobi_1: Setting Powered False 20:44:54.726745 bus /gobi_1: Setting Powered False 20:44:55.841765 bus /gobi_0: Setting Powered False 20:44:56.940166 bus /gobi_0: Setting Powered False 20:44:58.055419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx ping.py ---------------------------------------------- 20:44:59.157544 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.168637 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:44:59.224605 tst ping.py: using LAC 23610 20:44:59.342409 tst ping.py: using RAC 150 20:44:59.463188 tst ping.py: using CellId 23610 20:44:59.579879 tst ping.py: using BVCI 23611 20:44:59.687897 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.698502 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.708870 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.719545 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.730115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.740533 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.751222 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:44:59.761845 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:44:59.879875 tst ping.py:19: start network... 20:45:00.096755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:00.592227 run create_hlr_db(pid=13252): Launched 20:45:00.721899 bus /gobi_6: Setting Powered False 20:45:01.817493 run create_hlr_db(pid=13252): Terminated: ok {rc=0} 20:45:02.317179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13257): Launched 20:45:02.636785 run osmo-hlr_10.42.42.2(pid=13258): Launched 20:45:02.760048 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:03.311315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13260): Launched 20:45:03.631179 run osmo-stp_10.42.42.5(pid=13261): Launched 20:45:03.755418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:04.309947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13263): Launched 20:45:04.431775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:04.702319 run patchelf(pid=13264): Launched 20:45:04.879660 run osmo-stp_10.42.42.5(pid=13261): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13261)] 20:45:05.014732 run osmo-stp_10.42.42.5(pid=13261): stdout: | (launched: 2022-12-09_20:45:03.572659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:05.151583 run osmo-stp_10.42.42.5(pid=13261): stderr: | 20221209204503763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204503763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204503764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204503764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204503765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204503765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204503765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:05.288418 run osmo-stp_10.42.42.5(pid=13261): stdout: | (launched: 2022-12-09_20:45:03.572659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:05.419379 run osmo-stp_10.42.42.5(pid=13261): stderr: | 20221209204503763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204503763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204503764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204503764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204503765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204503765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204503765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:05.575198 run patchelf(pid=13264): Terminating (SIGINT) 20:45:05.753885 run patchelf(pid=13264): Terminated: ok {rc=0} 20:45:05.882617 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13261): Process ended prematurely: osmo-stp_10.42.42.5(pid=13261) [trial-2364↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13261)] [trial-2364↪gprs:trx-umtrx↪ping.py:22] 20:45:05.892168 tst ping.py:22: Test FAILED (6.7 sec) 20:45:05.920306 run osmo-hlr_10.42.42.2(pid=13258): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13258)] 20:45:05.970411 run osmo-hlr_10.42.42.2(pid=13258): stdout: | (launched: 2022-12-09_20:45:02.578514) 20:45:06.022339 run osmo-hlr_10.42.42.2(pid=13258): stderr: | 20221209204502777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204502777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204502777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204502777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204502777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204502777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204502788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204502797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204502797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204502797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:06.074288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13257): Terminating (SIGTERM) 20:45:06.115667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13260): Terminating (SIGTERM) 20:45:06.157340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13263): Terminating (SIGTERM) 20:45:06.199211 --- ParallelTerminationStrategy: PID 13257 died... 20:45:06.219144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13257): Terminated: ok {rc=0} 20:45:06.265368 --- ParallelTerminationStrategy: PID 13260 died... 20:45:06.284867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13260): Terminated: ok {rc=0} 20:45:06.330647 --- ParallelTerminationStrategy: PID 13263 died... 20:45:06.350347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13263): Terminated: ok {rc=0} 20:45:06.437867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 20:45:07.525164 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:07.537448 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 20:45:07.588164 tst ping_idle_ping.py: using LAC 23611 20:45:07.713658 tst ping_idle_ping.py: using RAC 151 20:45:07.838561 tst ping_idle_ping.py: using CellId 23611 20:45:07.964289 tst ping_idle_ping.py: using BVCI 23612 20:45:08.074856 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.085628 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.095972 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.106647 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.117262 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.127703 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.138460 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 20:45:08.148923 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 20:45:08.266480 tst ping_idle_ping.py:24: start network... 20:45:08.483800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:08.983019 run create_hlr_db(pid=13265): Launched 20:45:09.115099 bus /gobi_6: Setting Powered False 20:45:10.178552 run create_hlr_db(pid=13265): Terminated: ok {rc=0} 20:45:10.607744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Launched 20:45:10.906565 run osmo-hlr_10.42.42.2(pid=13268): Launched 20:45:11.020859 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:11.539671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Launched 20:45:11.838105 run osmo-stp_10.42.42.5(pid=13271): Launched 20:45:11.952276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:12.468624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13273): Launched 20:45:12.583438 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:12.837338 run patchelf(pid=13274): Launched 20:45:13.003146 run osmo-stp_10.42.42.5(pid=13271): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] 20:45:13.129636 run osmo-stp_10.42.42.5(pid=13271): stdout: | (launched: 2022-12-09_20:45:11.782975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:13.257781 run osmo-stp_10.42.42.5(pid=13271): stderr: | 20221209204511952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204511952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204511953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204511953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204511954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204511954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204511954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:13.386727 run osmo-stp_10.42.42.5(pid=13271): stdout: | (launched: 2022-12-09_20:45:11.782975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:13.509407 run osmo-stp_10.42.42.5(pid=13271): stderr: | 20221209204511952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204511952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204511953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204511953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204511954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204511954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204511954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:13.654744 run patchelf(pid=13274): Terminating (SIGINT) 20:45:13.822606 run patchelf(pid=13274): Terminated: ok {rc=0} 20:45:13.943738 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13271): Process ended prematurely: osmo-stp_10.42.42.5(pid=13271) [trial-2364↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] [trial-2364↪gprs:trx-umtrx↪ping_idle_ping.py:27] 20:45:13.952744 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:45:13.980203 run osmo-hlr_10.42.42.2(pid=13268): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13268)] 20:45:14.028020 run osmo-hlr_10.42.42.2(pid=13268): stdout: | (launched: 2022-12-09_20:45:10.851243) 20:45:14.077565 run osmo-hlr_10.42.42.2(pid=13268): stderr: | 20221209204511029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204511029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204511029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204511029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204511029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204511029 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204511041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204511049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204511050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204511050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:14.127512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Terminating (SIGTERM) 20:45:14.167317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Terminating (SIGTERM) 20:45:14.207304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13273): Terminating (SIGTERM) 20:45:14.247206 --- ParallelTerminationStrategy: PID 13267 died... 20:45:14.266248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Terminated: ok {rc=0} 20:45:14.310546 --- ParallelTerminationStrategy: PID 13270 died... 20:45:14.328933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Terminated: ok {rc=0} 20:45:14.373349 --- ParallelTerminationStrategy: PID 13273 died... 20:45:14.391894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13273): Terminated: ok {rc=0} 20:45:14.477221 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 20:45:15.774319 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:45:15.779735 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:45:15.812566 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:45:15.860429 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:45:15.961414 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:45:15.996869 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:45:16.038411 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:45:16.627738 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:45:16.685264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:16.697236 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:16.754488 tst cs_paging_gprs_active.py: using LAC 23612 20:45:16.890170 tst cs_paging_gprs_active.py: using RAC 152 20:45:17.045164 tst cs_paging_gprs_active.py: using CellId 23612 20:45:17.200586 tst cs_paging_gprs_active.py: using BVCI 23613 20:45:17.323715 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.335605 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.347371 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.358701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.369731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.380868 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.392378 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.403331 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:17.414788 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:17.532356 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:17.651729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:45:17.873210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:18.201313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13278): Launched 20:45:18.484444 run iperf3-srv_10.42.42.10(pid=13279): Launched 20:45:18.606763 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:45:18.826838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:19.153695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13280): Launched 20:45:19.436705 run iperf3-srv_10.42.42.10(pid=13281): Launched 20:45:19.558848 tst cs_paging_gprs_active.py:38: start network... 20:45:19.779076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:20.285521 run create_hlr_db(pid=13282): Launched 20:45:20.417298 bus /gobi_6: Setting Powered False 20:45:21.480379 run create_hlr_db(pid=13282): Terminated: ok {rc=0} 20:45:21.913727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13284): Launched 20:45:22.217807 run osmo-hlr_10.42.42.2(pid=13285): Launched 20:45:22.334361 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:22.859329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13287): Launched 20:45:23.162934 run osmo-stp_10.42.42.5(pid=13288): Launched 20:45:23.279055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:23.803280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13290): Launched 20:45:23.919369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:24.176912 run patchelf(pid=13291): Launched 20:45:24.346209 run osmo-stp_10.42.42.5(pid=13288): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13288)] 20:45:24.475148 run osmo-stp_10.42.42.5(pid=13288): stdout: | (launched: 2022-12-09_20:45:23.107139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:24.605499 run osmo-stp_10.42.42.5(pid=13288): stderr: | 20221209204523276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204523276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204523276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204523276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204523277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204523277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204523277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:24.735559 run osmo-stp_10.42.42.5(pid=13288): stdout: | (launched: 2022-12-09_20:45:23.107139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:24.860070 run osmo-stp_10.42.42.5(pid=13288): stderr: | 20221209204523276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204523276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204523276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204523276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204523277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204523277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204523277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:25.007501 run patchelf(pid=13291): Terminating (SIGINT) 20:45:25.179139 run patchelf(pid=13291): Terminated: ok {rc=0} 20:45:25.302397 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13288): Process ended prematurely: osmo-stp_10.42.42.5(pid=13288) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13288)] [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:45:25.311851 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:45:25.339270 run osmo-hlr_10.42.42.2(pid=13285): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13285)] 20:45:25.386626 run osmo-hlr_10.42.42.2(pid=13285): stdout: | (launched: 2022-12-09_20:45:22.162088) 20:45:25.435695 run osmo-hlr_10.42.42.2(pid=13285): stderr: | 20221209204522338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204522339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204522339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204522339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204522339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204522339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204522351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204522361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204522362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204522362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:25.485026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13278): Terminating (SIGTERM) 20:45:25.524413 run iperf3-srv_10.42.42.10(pid=13279): Terminating (SIGTERM) 20:45:25.563663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13280): Terminating (SIGTERM) 20:45:25.602986 run iperf3-srv_10.42.42.10(pid=13281): Terminating (SIGTERM) 20:45:25.642076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13284): Terminating (SIGTERM) 20:45:25.681481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13287): Terminating (SIGTERM) 20:45:25.720923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13290): Terminating (SIGTERM) 20:45:25.760035 --- ParallelTerminationStrategy: PID 13278 died... 20:45:25.779118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13278): Terminated: ok {rc=0} 20:45:25.823303 --- ParallelTerminationStrategy: PID 13279 died... 20:45:25.841631 run iperf3-srv_10.42.42.10(pid=13279): Terminated {rc=256} 20:45:25.885204 --- ParallelTerminationStrategy: PID 13280 died... 20:45:25.903549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13280): Terminated: ok {rc=0} 20:45:25.947327 --- ParallelTerminationStrategy: PID 13281 died... 20:45:25.965748 run iperf3-srv_10.42.42.10(pid=13281): Terminated {rc=256} 20:45:26.009126 --- ParallelTerminationStrategy: PID 13284 died... 20:45:26.027485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13284): Terminated: ok {rc=0} 20:45:26.071220 --- ParallelTerminationStrategy: PID 13287 died... 20:45:26.089548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13287): Terminated: ok {rc=0} 20:45:26.133908 --- ParallelTerminationStrategy: PID 13290 died... 20:45:26.152246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13290): Terminated: ok {rc=0} 20:45:26.237209 bus /gobi_0: Setting Powered False 20:45:27.336835 bus /gobi_0: Setting Powered False 20:45:28.452270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:45:29.600606 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:29.612499 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:29.665777 tst iperf3.py: using LAC 23613 20:45:29.787012 tst iperf3.py: using RAC 153 20:45:29.908499 tst iperf3.py: using CellId 23613 20:45:30.028248 tst iperf3.py: using BVCI 23614 20:45:30.141275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.152051 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.162990 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.174094 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.185137 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.195977 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.207121 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.217963 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:30.228890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:30.347597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:45:30.569025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:30.910047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Launched 20:45:31.200648 run iperf3-srv_10.42.42.10(pid=13293): Launched 20:45:31.337389 tst iperf3.py:8: start network... 20:45:31.561293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:32.078872 run create_hlr_db(pid=13294): Launched 20:45:32.241828 bus /gobi_6: Setting Powered False 20:45:33.305990 run create_hlr_db(pid=13294): Terminated: ok {rc=0} 20:45:33.736935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Launched 20:45:34.062309 run osmo-hlr_10.42.42.2(pid=13297): Launched 20:45:34.186288 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:34.755937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Launched 20:45:35.080763 run osmo-stp_10.42.42.5(pid=13300): Launched 20:45:35.205354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:35.765642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Launched 20:45:35.888864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:36.163022 run patchelf(pid=13303): Launched 20:45:36.343220 run osmo-stp_10.42.42.5(pid=13300): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] 20:45:36.479936 run osmo-stp_10.42.42.5(pid=13300): stdout: | (launched: 2022-12-09_20:45:35.021419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:36.617917 run osmo-stp_10.42.42.5(pid=13300): stderr: | 20221209204535215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204535215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204535215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204535216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204535216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204535216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204535216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:36.755634 run osmo-stp_10.42.42.5(pid=13300): stdout: | (launched: 2022-12-09_20:45:35.021419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:36.887785 run osmo-stp_10.42.42.5(pid=13300): stderr: | 20221209204535215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204535215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204535215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204535216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204535216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204535216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204535216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:37.044343 run patchelf(pid=13303): Terminating (SIGINT) 20:45:37.224875 run patchelf(pid=13303): Terminated: ok {rc=0} 20:45:37.355327 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13300): Process ended prematurely: osmo-stp_10.42.42.5(pid=13300) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 20:45:37.365540 tst iperf3.py:8: Test FAILED (7.8 sec) 20:45:37.393939 run osmo-hlr_10.42.42.2(pid=13297): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13297)] 20:45:37.443158 run osmo-hlr_10.42.42.2(pid=13297): stdout: | (launched: 2022-12-09_20:45:34.003174) 20:45:37.493973 run osmo-hlr_10.42.42.2(pid=13297): stderr: | 20221209204534202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204534202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204534202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204534202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204534202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204534202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204534215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204534223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204534223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204534223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:37.545119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Terminating (SIGTERM) 20:45:37.585653 run iperf3-srv_10.42.42.10(pid=13293): Terminating (SIGTERM) 20:45:37.626243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Terminating (SIGTERM) 20:45:37.667127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Terminating (SIGTERM) 20:45:37.707566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Terminating (SIGTERM) 20:45:37.748547 --- ParallelTerminationStrategy: PID 13292 died... 20:45:37.768209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Terminated: ok {rc=0} 20:45:37.813220 --- ParallelTerminationStrategy: PID 13293 died... 20:45:37.832280 run iperf3-srv_10.42.42.10(pid=13293): Terminated {rc=256} 20:45:37.877068 --- ParallelTerminationStrategy: PID 13296 died... 20:45:37.896187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13296): Terminated: ok {rc=0} 20:45:37.941371 --- ParallelTerminationStrategy: PID 13299 died... 20:45:37.960301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13299): Terminated: ok {rc=0} 20:45:38.005313 --- ParallelTerminationStrategy: PID 13302 died... 20:45:38.024333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13302): Terminated: ok {rc=0} 20:45:38.109899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:45:39.258230 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.269764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:39.318573 tst iperf3m4.py: using LAC 23614 20:45:39.440513 tst iperf3m4.py: using RAC 154 20:45:39.559737 tst iperf3m4.py: using CellId 23614 20:45:39.680453 tst iperf3m4.py: using BVCI 23615 20:45:39.791362 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.802183 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.812800 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.823915 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.834631 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.845546 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.856475 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.867141 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:39.878200 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:39.999249 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:40.121380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:40.238981 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:40.360362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:45:40.582216 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:40.909974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13304): Launched 20:45:41.193461 run iperf3-srv_10.42.42.10(pid=13305): Launched 20:45:41.315053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:45:41.535518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:41.862165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13306): Launched 20:45:42.144731 run iperf3-srv_10.42.42.10(pid=13307): Launched 20:45:42.266786 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:45:42.486961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:42.813926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13308): Launched 20:45:43.097047 run iperf3-srv_10.42.42.10(pid=13309): Launched 20:45:43.218669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:45:43.438580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:45:43.766358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13310): Launched 20:45:44.049364 run iperf3-srv_10.42.42.10(pid=13311): Launched 20:45:44.170554 tst iperf3m4.py:8: start network... 20:45:44.390890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:45:44.898278 run create_hlr_db(pid=13312): Launched 20:45:45.030027 bus /gobi_6: Setting Powered False 20:45:46.106947 run create_hlr_db(pid=13312): Terminated: ok {rc=0} 20:45:46.610997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13314): Launched 20:45:46.941075 run osmo-hlr_10.42.42.2(pid=13315): Launched 20:45:47.066893 run osmo-stp_10.42.42.5: Starting osmo-stp 20:45:47.666404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13317): Launched 20:45:47.971213 run osmo-stp_10.42.42.5(pid=13318): Launched 20:45:48.087456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:45:48.614282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13320): Launched 20:45:48.730407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:45:48.988054 run patchelf(pid=13321): Launched 20:45:49.157469 run osmo-stp_10.42.42.5(pid=13318): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13318)] 20:45:49.286136 run osmo-stp_10.42.42.5(pid=13318): stdout: | (launched: 2022-12-09_20:45:47.915244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:49.416522 run osmo-stp_10.42.42.5(pid=13318): stderr: | 20221209204548082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204548082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204548082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204548083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204548083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204548083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204548083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:49.546859 run osmo-stp_10.42.42.5(pid=13318): stdout: | (launched: 2022-12-09_20:45:47.915244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:45:49.671686 run osmo-stp_10.42.42.5(pid=13318): stderr: | 20221209204548082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204548082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204548082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204548083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204548083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204548083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204548083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:45:49.819814 run patchelf(pid=13321): Terminating (SIGINT) 20:45:49.990559 run patchelf(pid=13321): Terminated: ok {rc=0} 20:45:50.113886 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13318): Process ended prematurely: osmo-stp_10.42.42.5(pid=13318) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13318)] [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 20:45:50.123353 tst iperf3m4.py:8: Test FAILED (10.9 sec) 20:45:50.150950 run osmo-hlr_10.42.42.2(pid=13315): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13315)] 20:45:50.198501 run osmo-hlr_10.42.42.2(pid=13315): stdout: | (launched: 2022-12-09_20:45:46.880712) 20:45:50.247332 run osmo-hlr_10.42.42.2(pid=13315): stderr: | 20221209204547253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204547253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204547253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204547253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204547253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204547253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204547312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204547321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204547322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204547322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:45:50.297300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13304): Terminating (SIGTERM) 20:45:50.337167 run iperf3-srv_10.42.42.10(pid=13305): Terminating (SIGTERM) 20:45:50.376729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13306): Terminating (SIGTERM) 20:45:50.416504 run iperf3-srv_10.42.42.10(pid=13307): Terminating (SIGTERM) 20:45:50.455993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13308): Terminating (SIGTERM) 20:45:50.495630 run iperf3-srv_10.42.42.10(pid=13309): Terminating (SIGTERM) 20:45:50.535066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13310): Terminating (SIGTERM) 20:45:50.574612 run iperf3-srv_10.42.42.10(pid=13311): Terminating (SIGTERM) 20:45:50.614028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13314): Terminating (SIGTERM) 20:45:50.653678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13317): Terminating (SIGTERM) 20:45:50.693180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13320): Terminating (SIGTERM) 20:45:50.733660 --- ParallelTerminationStrategy: PID 13304 died... 20:45:50.752724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13304): Terminated: ok {rc=0} 20:45:50.797380 --- ParallelTerminationStrategy: PID 13305 died... 20:45:50.815601 run iperf3-srv_10.42.42.10(pid=13305): Terminated {rc=256} 20:45:50.860222 --- ParallelTerminationStrategy: PID 13306 died... 20:45:50.878780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13306): Terminated: ok {rc=0} 20:45:50.922872 --- ParallelTerminationStrategy: PID 13307 died... 20:45:50.941357 run iperf3-srv_10.42.42.10(pid=13307): Terminated {rc=256} 20:45:50.985323 --- ParallelTerminationStrategy: PID 13308 died... 20:45:51.003645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13308): Terminated: ok {rc=0} 20:45:51.047924 --- ParallelTerminationStrategy: PID 13309 died... 20:45:51.066568 run iperf3-srv_10.42.42.10(pid=13309): Terminated {rc=256} 20:45:51.110631 --- ParallelTerminationStrategy: PID 13310 died... 20:45:51.129215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13310): Terminated: ok {rc=0} 20:45:51.173317 --- ParallelTerminationStrategy: PID 13311 died... 20:45:51.191768 run iperf3-srv_10.42.42.10(pid=13311): Terminated {rc=256} 20:45:51.235935 --- ParallelTerminationStrategy: PID 13314 died... 20:45:51.254617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13314): Terminated: ok {rc=0} 20:45:51.298806 --- ParallelTerminationStrategy: PID 13317 died... 20:45:51.317452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13317): Terminated: ok {rc=0} 20:45:51.361642 --- ParallelTerminationStrategy: PID 13320 died... 20:45:51.380322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13320): Terminated: ok {rc=0} 20:45:51.463866 bus /gobi_4: Setting Powered False 20:45:52.558381 bus /gobi_4: Setting Powered False 20:45:53.670361 bus /gobi_1: Setting Powered False 20:45:54.767926 bus /gobi_1: Setting Powered False 20:45:55.882583 bus /gobi_0: Setting Powered False 20:45:56.980805 bus /gobi_0: Setting Powered False 20:45:58.098980 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 20:45:59.204032 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.215872 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:45:59.266608 tst ping.py: using LAC 23615 20:45:59.393811 tst ping.py: using RAC 155 20:45:59.520092 tst ping.py: using CellId 23615 20:45:59.652007 tst ping.py: using BVCI 23616 20:45:59.769205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.780354 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.791368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.802491 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.813477 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.824429 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.835588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:45:59.846598 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:45:59.965531 tst ping.py:19: start network... 20:46:00.180346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:00.678311 run create_hlr_db(pid=13322): Launched 20:46:00.808905 bus /gobi_6: Setting Powered False 20:46:01.892163 run create_hlr_db(pid=13322): Terminated: ok {rc=0} 20:46:02.358579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13324): Launched 20:46:02.679684 run osmo-hlr_10.42.42.2(pid=13325): Launched 20:46:02.801566 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:03.353695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13327): Launched 20:46:03.671526 run osmo-stp_10.42.42.5(pid=13328): Launched 20:46:03.791878 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:04.341829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13330): Launched 20:46:04.463945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:04.733924 run patchelf(pid=13331): Launched 20:46:04.910735 run osmo-stp_10.42.42.5(pid=13328): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13328)] 20:46:05.045681 run osmo-stp_10.42.42.5(pid=13328): stdout: | (launched: 2022-12-09_20:46:03.613342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:05.182564 run osmo-stp_10.42.42.5(pid=13328): stderr: | 20221209204603805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204603805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204603805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204603806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204603808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204603808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204603808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:05.319378 run osmo-stp_10.42.42.5(pid=13328): stdout: | (launched: 2022-12-09_20:46:03.613342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:05.450649 run osmo-stp_10.42.42.5(pid=13328): stderr: | 20221209204603805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204603805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204603805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204603806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204603808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204603808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204603808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:05.605800 run patchelf(pid=13331): Terminating (SIGINT) 20:46:05.784571 run patchelf(pid=13331): Terminated: ok {rc=0} 20:46:05.913346 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13328): Process ended prematurely: osmo-stp_10.42.42.5(pid=13328) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13328)] [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 20:46:05.922749 tst ping.py:22: Test FAILED (6.7 sec) 20:46:05.950798 run osmo-hlr_10.42.42.2(pid=13325): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13325)] 20:46:06.000481 run osmo-hlr_10.42.42.2(pid=13325): stdout: | (launched: 2022-12-09_20:46:02.621135) 20:46:06.051555 run osmo-hlr_10.42.42.2(pid=13325): stderr: | 20221209204602821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204602821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204602821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204602821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204602821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204602821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204602834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204602842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204602842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204602843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:06.103293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13324): Terminating (SIGTERM) 20:46:06.144675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13327): Terminating (SIGTERM) 20:46:06.186436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13330): Terminating (SIGTERM) 20:46:06.228306 --- ParallelTerminationStrategy: PID 13324 died... 20:46:06.248275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13324): Terminated: ok {rc=0} 20:46:06.294526 --- ParallelTerminationStrategy: PID 13327 died... 20:46:06.314241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13327): Terminated: ok {rc=0} 20:46:06.360134 --- ParallelTerminationStrategy: PID 13330 died... 20:46:06.379658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13330): Terminated: ok {rc=0} 20:46:06.466758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:46:07.554618 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:07.567061 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:46:07.620415 tst ping_idle_ping.py: using LAC 23616 20:46:07.749717 tst ping_idle_ping.py: using RAC 156 20:46:07.874538 tst ping_idle_ping.py: using CellId 23616 20:46:08.000842 tst ping_idle_ping.py: using BVCI 23617 20:46:08.117025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.128331 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.139407 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.150526 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.161611 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.172619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.183892 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:46:08.195004 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:46:08.312030 tst ping_idle_ping.py:24: start network... 20:46:08.531319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:09.031099 run create_hlr_db(pid=13332): Launched 20:46:09.161269 bus /gobi_6: Setting Powered False 20:46:10.225643 run create_hlr_db(pid=13332): Terminated: ok {rc=0} 20:46:10.672764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13334): Launched 20:46:10.993272 run osmo-hlr_10.42.42.2(pid=13335): Launched 20:46:11.115850 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:11.669131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13337): Launched 20:46:11.989274 run osmo-stp_10.42.42.5(pid=13338): Launched 20:46:12.111812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:12.668240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13340): Launched 20:46:12.790359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:13.061357 run patchelf(pid=13341): Launched 20:46:13.238751 run osmo-stp_10.42.42.5(pid=13338): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13338)] 20:46:13.374595 run osmo-stp_10.42.42.5(pid=13338): stdout: | (launched: 2022-12-09_20:46:11.930582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:13.512520 run osmo-stp_10.42.42.5(pid=13338): stderr: | 20221209204612122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204612122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204612122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204612123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204612123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204612123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204612123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:13.650296 run osmo-stp_10.42.42.5(pid=13338): stdout: | (launched: 2022-12-09_20:46:11.930582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:13.781946 run osmo-stp_10.42.42.5(pid=13338): stderr: | 20221209204612122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204612122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204612122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204612123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204612123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204612123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204612123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:13.937829 run patchelf(pid=13341): Terminating (SIGINT) 20:46:14.118173 run patchelf(pid=13341): Terminated: ok {rc=0} 20:46:14.248288 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13338): Process ended prematurely: osmo-stp_10.42.42.5(pid=13338) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13338)] [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 20:46:14.257887 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:46:14.285973 run osmo-hlr_10.42.42.2(pid=13335): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13335)] 20:46:14.335997 run osmo-hlr_10.42.42.2(pid=13335): stdout: | (launched: 2022-12-09_20:46:10.934380) 20:46:14.387571 run osmo-hlr_10.42.42.2(pid=13335): stderr: | 20221209204611135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204611135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204611135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204611135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204611135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204611135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204611152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204611160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204611160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204611161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:14.439463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13334): Terminating (SIGTERM) 20:46:14.481623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13337): Terminating (SIGTERM) 20:46:14.523961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13340): Terminating (SIGTERM) 20:46:14.566501 --- ParallelTerminationStrategy: PID 13334 died... 20:46:14.586477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13334): Terminated: ok {rc=0} 20:46:14.632565 --- ParallelTerminationStrategy: PID 13337 died... 20:46:14.652210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13337): Terminated: ok {rc=0} 20:46:14.698184 --- ParallelTerminationStrategy: PID 13340 died... 20:46:14.717873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13340): Terminated: ok {rc=0} 20:46:14.805809 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:46:16.136260 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:46:16.150548 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:46:16.206293 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:46:16.246111 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:46:16.336286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:46:16.386955 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:46:16.437710 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:46:16.999249 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:46:17.052843 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.064623 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:17.136806 tst cs_paging_gprs_active.py: using LAC 23617 20:46:17.270674 tst cs_paging_gprs_active.py: using RAC 157 20:46:17.401511 tst cs_paging_gprs_active.py: using CellId 23617 20:46:17.523924 tst cs_paging_gprs_active.py: using BVCI 23618 20:46:17.636266 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.647099 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.657716 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.668314 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.680597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.691879 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.703275 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.714548 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:17.726096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:17.842356 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:17.960650 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:46:18.166276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:18.471338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13346): Launched 20:46:18.735793 run iperf3-srv_10.42.42.10(pid=13347): Launched 20:46:18.848783 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:46:19.052138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:19.356534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13348): Launched 20:46:19.619860 run iperf3-srv_10.42.42.10(pid=13349): Launched 20:46:19.733160 tst cs_paging_gprs_active.py:38: start network... 20:46:19.936640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:20.409388 run create_hlr_db(pid=13350): Launched 20:46:20.525364 bus /gobi_6: Setting Powered False 20:46:21.586485 run create_hlr_db(pid=13350): Terminated: ok {rc=0} 20:46:22.029922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13352): Launched 20:46:22.355601 run osmo-hlr_10.42.42.2(pid=13353): Launched 20:46:22.480507 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:23.043330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13355): Launched 20:46:23.368766 run osmo-stp_10.42.42.5(pid=13356): Launched 20:46:23.493004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:24.055346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13358): Launched 20:46:24.179758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:24.462645 run patchelf(pid=13359): Launched 20:46:24.645306 run osmo-stp_10.42.42.5(pid=13356): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13356)] 20:46:24.783420 run osmo-stp_10.42.42.5(pid=13356): stdout: | (launched: 2022-12-09_20:46:23.309545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:24.923064 run osmo-stp_10.42.42.5(pid=13356): stderr: | 20221209204623500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204623501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204623501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204623501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204623502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204623502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204623502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:25.062921 run osmo-stp_10.42.42.5(pid=13356): stdout: | (launched: 2022-12-09_20:46:23.309545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:25.196676 run osmo-stp_10.42.42.5(pid=13356): stderr: | 20221209204623500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204623501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204623501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204623501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204623502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204623502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204623502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:25.355161 run patchelf(pid=13359): Terminating (SIGINT) 20:46:25.538381 run patchelf(pid=13359): Terminated: ok {rc=0} 20:46:25.670099 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13356): Process ended prematurely: osmo-stp_10.42.42.5(pid=13356) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13356)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:46:25.680297 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 20:46:25.711989 run osmo-hlr_10.42.42.2(pid=13353): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13353)] 20:46:25.763525 run osmo-hlr_10.42.42.2(pid=13353): stdout: | (launched: 2022-12-09_20:46:22.295904) 20:46:25.814819 run osmo-hlr_10.42.42.2(pid=13353): stderr: | 20221209204622493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204622493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204622493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204622493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204622493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204622493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204622506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204622515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204622516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204622516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:25.866667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13346): Terminating (SIGTERM) 20:46:25.907966 run iperf3-srv_10.42.42.10(pid=13347): Terminating (SIGTERM) 20:46:25.949787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13348): Terminating (SIGTERM) 20:46:25.989163 run iperf3-srv_10.42.42.10(pid=13349): Terminating (SIGTERM) 20:46:26.028246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13352): Terminating (SIGTERM) 20:46:26.067707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13355): Terminating (SIGTERM) 20:46:26.107327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13358): Terminating (SIGTERM) 20:46:26.146510 --- ParallelTerminationStrategy: PID 13346 died... 20:46:26.165428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13346): Terminated: ok {rc=0} 20:46:26.208883 --- ParallelTerminationStrategy: PID 13347 died... 20:46:26.227647 run iperf3-srv_10.42.42.10(pid=13347): Terminated {rc=256} 20:46:26.271274 --- ParallelTerminationStrategy: PID 13348 died... 20:46:26.289760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13348): Terminated: ok {rc=0} 20:46:26.333392 --- ParallelTerminationStrategy: PID 13349 died... 20:46:26.351750 run iperf3-srv_10.42.42.10(pid=13349): Terminated {rc=256} 20:46:26.395442 --- ParallelTerminationStrategy: PID 13352 died... 20:46:26.413814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13352): Terminated: ok {rc=0} 20:46:26.458074 --- ParallelTerminationStrategy: PID 13355 died... 20:46:26.476473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13355): Terminated: ok {rc=0} 20:46:26.520181 --- ParallelTerminationStrategy: PID 13358 died... 20:46:26.538720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13358): Terminated: ok {rc=0} 20:46:26.623784 bus /gobi_0: Setting Powered False 20:46:27.723186 bus /gobi_0: Setting Powered False 20:46:28.837461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:46:29.987333 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:29.999416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:30.072675 tst iperf3.py: using LAC 23618 20:46:30.192165 tst iperf3.py: using RAC 158 20:46:30.309802 tst iperf3.py: using CellId 23618 20:46:30.436818 tst iperf3.py: using BVCI 23619 20:46:30.555700 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.567029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.578298 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.590064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.601272 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.612293 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.623501 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.634743 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:30.645928 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:30.765462 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:46:30.999283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:31.317126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Launched 20:46:31.605662 run iperf3-srv_10.42.42.10(pid=13361): Launched 20:46:31.740851 tst iperf3.py:8: start network... 20:46:31.952694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:32.430916 run create_hlr_db(pid=13362): Launched 20:46:32.546734 bus /gobi_6: Setting Powered False 20:46:33.607119 run create_hlr_db(pid=13362): Terminated: ok {rc=0} 20:46:34.029245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13364): Launched 20:46:34.332220 run osmo-hlr_10.42.42.2(pid=13365): Launched 20:46:34.447951 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:35.072557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13367): Launched 20:46:35.369775 run osmo-stp_10.42.42.5(pid=13368): Launched 20:46:35.483883 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:36.033616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13370): Launched 20:46:36.155200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:36.424257 run patchelf(pid=13371): Launched 20:46:36.601455 run osmo-stp_10.42.42.5(pid=13368): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13368)] 20:46:36.736625 run osmo-stp_10.42.42.5(pid=13368): stdout: | (launched: 2022-12-09_20:46:35.315168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:36.872617 run osmo-stp_10.42.42.5(pid=13368): stderr: | 20221209204635483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204635483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204635483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204635484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204635484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204635484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204635484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:37.008705 run osmo-stp_10.42.42.5(pid=13368): stdout: | (launched: 2022-12-09_20:46:35.315168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:37.139109 run osmo-stp_10.42.42.5(pid=13368): stderr: | 20221209204635483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204635483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204635483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204635484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204635484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204635484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204635484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:37.293489 run patchelf(pid=13371): Terminating (SIGINT) 20:46:37.471714 run patchelf(pid=13371): Terminated: ok {rc=0} 20:46:37.600646 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13368): Process ended prematurely: osmo-stp_10.42.42.5(pid=13368) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13368)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 20:46:37.610793 tst iperf3.py:8: Test FAILED (7.7 sec) 20:46:37.639207 run osmo-hlr_10.42.42.2(pid=13365): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13365)] 20:46:37.688497 run osmo-hlr_10.42.42.2(pid=13365): stdout: | (launched: 2022-12-09_20:46:34.276547) 20:46:37.739509 run osmo-hlr_10.42.42.2(pid=13365): stderr: | 20221209204634455 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204634455 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204634455 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204634455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204634455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204634455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204634467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204634477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204634477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204634477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:37.790883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Terminating (SIGTERM) 20:46:37.831906 run iperf3-srv_10.42.42.10(pid=13361): Terminating (SIGTERM) 20:46:37.872806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13364): Terminating (SIGTERM) 20:46:37.914347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13367): Terminating (SIGTERM) 20:46:37.955435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13370): Terminating (SIGTERM) 20:46:37.996863 --- ParallelTerminationStrategy: PID 13360 died... 20:46:38.016607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Terminated: ok {rc=0} 20:46:38.062501 --- ParallelTerminationStrategy: PID 13361 died... 20:46:38.081911 run iperf3-srv_10.42.42.10(pid=13361): Terminated {rc=256} 20:46:38.127238 --- ParallelTerminationStrategy: PID 13364 died... 20:46:38.146730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13364): Terminated: ok {rc=0} 20:46:38.191844 --- ParallelTerminationStrategy: PID 13367 died... 20:46:38.211059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13367): Terminated: ok {rc=0} 20:46:38.256784 --- ParallelTerminationStrategy: PID 13370 died... 20:46:38.276358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13370): Terminated: ok {rc=0} 20:46:38.362880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:46:39.515516 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:39.527630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:39.597757 tst iperf3m4.py: using LAC 23619 20:46:39.724841 tst iperf3m4.py: using RAC 159 20:46:39.851777 tst iperf3m4.py: using CellId 23619 20:46:39.978849 tst iperf3m4.py: using BVCI 23620 20:46:40.095861 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.107134 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.118166 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.129182 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.140087 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.151151 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.162233 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.173136 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:40.184222 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:40.302811 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:40.420617 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:40.541544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:40.658343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:46:40.858847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:41.157644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13372): Launched 20:46:41.417700 run iperf3-srv_10.42.42.10(pid=13373): Launched 20:46:41.530069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:46:41.729998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:42.029803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13374): Launched 20:46:42.289146 run iperf3-srv_10.42.42.10(pid=13375): Launched 20:46:42.400257 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:46:42.599501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:42.898600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13376): Launched 20:46:43.157625 run iperf3-srv_10.42.42.10(pid=13377): Launched 20:46:43.269096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:46:43.469347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:46:43.769707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13378): Launched 20:46:44.028073 run iperf3-srv_10.42.42.10(pid=13379): Launched 20:46:44.139212 tst iperf3m4.py:8: start network... 20:46:44.338798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:46:44.804005 run create_hlr_db(pid=13380): Launched 20:46:44.934855 bus /gobi_6: Setting Powered False 20:46:46.008264 run create_hlr_db(pid=13380): Terminated: ok {rc=0} 20:46:46.438084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Launched 20:46:46.770366 run osmo-hlr_10.42.42.2(pid=13383): Launched 20:46:47.021479 run osmo-stp_10.42.42.5: Starting osmo-stp 20:46:47.585755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Launched 20:46:47.883379 run osmo-stp_10.42.42.5(pid=13386): Launched 20:46:47.995774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:46:48.513804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13388): Launched 20:46:48.627576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:46:48.881109 run patchelf(pid=13389): Launched 20:46:49.046568 run osmo-stp_10.42.42.5(pid=13386): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] 20:46:49.172796 run osmo-stp_10.42.42.5(pid=13386): stdout: | (launched: 2022-12-09_20:46:47.828775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:49.300858 run osmo-stp_10.42.42.5(pid=13386): stderr: | 20221209204647994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204647994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204647994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204647995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204647995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204647995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204647995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:49.429344 run osmo-stp_10.42.42.5(pid=13386): stdout: | (launched: 2022-12-09_20:46:47.828775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:46:49.551670 run osmo-stp_10.42.42.5(pid=13386): stderr: | 20221209204647994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204647994 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204647994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204647995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204647995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204647995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204647995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:46:49.697084 run patchelf(pid=13389): Terminating (SIGINT) 20:46:49.864661 run patchelf(pid=13389): Terminated: ok {rc=0} 20:46:49.985819 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13386): Process ended prematurely: osmo-stp_10.42.42.5(pid=13386) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:46:49.995337 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:46:50.022734 run osmo-hlr_10.42.42.2(pid=13383): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13383)] 20:46:50.070543 run osmo-hlr_10.42.42.2(pid=13383): stdout: | (launched: 2022-12-09_20:46:46.699864) 20:46:50.119630 run osmo-hlr_10.42.42.2(pid=13383): stderr: | 20221209204646990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204646990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204646991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204646991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204646991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204646991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204647006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204647025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204647026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204647026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:46:50.169143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13372): Terminating (SIGTERM) 20:46:50.208760 run iperf3-srv_10.42.42.10(pid=13373): Terminating (SIGTERM) 20:46:50.248185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13374): Terminating (SIGTERM) 20:46:50.287176 run iperf3-srv_10.42.42.10(pid=13375): Terminating (SIGTERM) 20:46:50.326132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13376): Terminating (SIGTERM) 20:46:50.365167 run iperf3-srv_10.42.42.10(pid=13377): Terminating (SIGTERM) 20:46:50.403955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13378): Terminating (SIGTERM) 20:46:50.442970 run iperf3-srv_10.42.42.10(pid=13379): Terminating (SIGTERM) 20:46:50.481818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Terminating (SIGTERM) 20:46:50.520839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Terminating (SIGTERM) 20:46:50.559843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13388): Terminating (SIGTERM) 20:46:50.599211 --- ParallelTerminationStrategy: PID 13372 died... 20:46:50.617882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13372): Terminated: ok {rc=0} 20:46:50.661534 --- ParallelTerminationStrategy: PID 13373 died... 20:46:50.679550 run iperf3-srv_10.42.42.10(pid=13373): Terminated {rc=256} 20:46:50.722918 --- ParallelTerminationStrategy: PID 13374 died... 20:46:50.741010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13374): Terminated: ok {rc=0} 20:46:50.784277 --- ParallelTerminationStrategy: PID 13375 died... 20:46:50.802703 run iperf3-srv_10.42.42.10(pid=13375): Terminated {rc=256} 20:46:50.846324 --- ParallelTerminationStrategy: PID 13376 died... 20:46:50.864339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13376): Terminated: ok {rc=0} 20:46:50.907583 --- ParallelTerminationStrategy: PID 13377 died... 20:46:50.925617 run iperf3-srv_10.42.42.10(pid=13377): Terminated {rc=256} 20:46:50.969642 --- ParallelTerminationStrategy: PID 13378 died... 20:46:50.987844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13378): Terminated: ok {rc=0} 20:46:51.032228 --- ParallelTerminationStrategy: PID 13379 died... 20:46:51.050568 run iperf3-srv_10.42.42.10(pid=13379): Terminated {rc=256} 20:46:51.094234 --- ParallelTerminationStrategy: PID 13382 died... 20:46:51.112453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13382): Terminated: ok {rc=0} 20:46:51.156653 --- ParallelTerminationStrategy: PID 13385 died... 20:46:51.174898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13385): Terminated: ok {rc=0} 20:46:51.218440 --- ParallelTerminationStrategy: PID 13388 died... 20:46:51.236842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13388): Terminated: ok {rc=0} 20:46:51.319982 bus /gobi_4: Setting Powered False 20:46:52.417463 bus /gobi_4: Setting Powered False 20:46:53.536867 bus /gobi_1: Setting Powered False 20:46:54.635209 bus /gobi_1: Setting Powered False 20:46:55.749626 bus /gobi_0: Setting Powered False 20:46:56.847031 bus /gobi_0: Setting Powered False 20:46:57.961898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:46:59.062900 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.075099 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:46:59.146956 tst ping.py: using LAC 23620 20:46:59.272132 tst ping.py: using RAC 160 20:46:59.394862 tst ping.py: using CellId 23620 20:46:59.518279 tst ping.py: using BVCI 23621 20:46:59.633689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.644938 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.655997 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.667075 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.678058 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.689110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.700276 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:46:59.711317 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:46:59.829432 tst ping.py:19: start network... 20:47:00.041666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:00.531172 run create_hlr_db(pid=13390): Launched 20:47:00.658477 bus /gobi_6: Setting Powered False 20:47:01.743910 run create_hlr_db(pid=13390): Terminated: ok {rc=0} 20:47:02.250114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Launched 20:47:02.548281 run osmo-hlr_10.42.42.2(pid=13393): Launched 20:47:02.661380 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:03.187376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Launched 20:47:03.481287 run osmo-stp_10.42.42.5(pid=13396): Launched 20:47:03.593221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:04.099364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13398): Launched 20:47:04.211256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:04.459547 run patchelf(pid=13399): Launched 20:47:04.622478 run osmo-stp_10.42.42.5(pid=13396): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] 20:47:04.746940 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-09_20:47:03.426783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:04.873183 run osmo-stp_10.42.42.5(pid=13396): stderr: | 20221209204703597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204703597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204703598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204703598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204703598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204703598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204703599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:04.999869 run osmo-stp_10.42.42.5(pid=13396): stdout: | (launched: 2022-12-09_20:47:03.426783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:05.120200 run osmo-stp_10.42.42.5(pid=13396): stderr: | 20221209204703597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204703597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204703598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204703598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204703598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204703598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204703599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:05.262795 run patchelf(pid=13399): Terminating (SIGINT) 20:47:05.427893 run patchelf(pid=13399): Terminated: ok {rc=0} 20:47:05.546842 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 20:47:05.555744 tst ping.py:22: Test FAILED (6.5 sec) 20:47:05.582455 run osmo-hlr_10.42.42.2(pid=13393): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13393)] 20:47:05.629558 run osmo-hlr_10.42.42.2(pid=13393): stdout: | (launched: 2022-12-09_20:47:02.494481) 20:47:05.678270 run osmo-hlr_10.42.42.2(pid=13393): stderr: | 20221209204702705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204702705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204702705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204702705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204702705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204702705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204702718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204702727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204702728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204702728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:05.727422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminating (SIGTERM) 20:47:05.766427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminating (SIGTERM) 20:47:05.805489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13398): Terminating (SIGTERM) 20:47:05.844697 --- ParallelTerminationStrategy: PID 13392 died... 20:47:05.863349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13392): Terminated: ok {rc=0} 20:47:05.906569 --- ParallelTerminationStrategy: PID 13395 died... 20:47:05.924601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13395): Terminated: ok {rc=0} 20:47:05.967610 --- ParallelTerminationStrategy: PID 13398 died... 20:47:05.985871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13398): Terminated: ok {rc=0} 20:47:06.070401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:47:07.158275 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.170103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:47:07.240413 tst ping_idle_ping.py: using LAC 23621 20:47:07.358092 tst ping_idle_ping.py: using RAC 161 20:47:07.473412 tst ping_idle_ping.py: using CellId 23621 20:47:07.589102 tst ping_idle_ping.py: using BVCI 23622 20:47:07.696103 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.706974 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.717628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.728446 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.739299 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.750220 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.761165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:47:07.771889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:47:07.885436 tst ping_idle_ping.py:24: start network... 20:47:08.082253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:08.537714 run create_hlr_db(pid=13400): Launched 20:47:08.649928 bus /gobi_6: Setting Powered False 20:47:09.708608 run create_hlr_db(pid=13400): Terminated: ok {rc=0} 20:47:10.140044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13402): Launched 20:47:10.438342 run osmo-hlr_10.42.42.2(pid=13403): Launched 20:47:10.550127 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:11.070990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13405): Launched 20:47:11.365489 run osmo-stp_10.42.42.5(pid=13406): Launched 20:47:11.477506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:11.985695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13408): Launched 20:47:12.098103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:12.349337 run patchelf(pid=13409): Launched 20:47:12.512369 run osmo-stp_10.42.42.5(pid=13406): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13406)] 20:47:12.637458 run osmo-stp_10.42.42.5(pid=13406): stdout: | (launched: 2022-12-09_20:47:11.311071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:12.764459 run osmo-stp_10.42.42.5(pid=13406): stderr: | 20221209204711479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204711479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204711480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204711480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204711481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204711481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204711481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:12.891211 run osmo-stp_10.42.42.5(pid=13406): stdout: | (launched: 2022-12-09_20:47:11.311071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:13.012411 run osmo-stp_10.42.42.5(pid=13406): stderr: | 20221209204711479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204711479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204711480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204711480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204711481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204711481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204711481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:13.155697 run patchelf(pid=13409): Terminating (SIGINT) 20:47:13.321692 run patchelf(pid=13409): Terminated: ok {rc=0} 20:47:13.441420 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13406): Process ended prematurely: osmo-stp_10.42.42.5(pid=13406) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13406)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:47:13.450369 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 20:47:13.477345 run osmo-hlr_10.42.42.2(pid=13403): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13403)] 20:47:13.525447 run osmo-hlr_10.42.42.2(pid=13403): stdout: | (launched: 2022-12-09_20:47:10.384400) 20:47:13.574890 run osmo-hlr_10.42.42.2(pid=13403): stderr: | 20221209204710561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204710561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204710561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204710561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204710561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204710561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204710572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204710581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204710581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204710581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:13.624778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13402): Terminating (SIGTERM) 20:47:13.664414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13405): Terminating (SIGTERM) 20:47:13.704086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13408): Terminating (SIGTERM) 20:47:13.743849 --- ParallelTerminationStrategy: PID 13402 died... 20:47:13.762695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13402): Terminated: ok {rc=0} 20:47:13.806774 --- ParallelTerminationStrategy: PID 13405 died... 20:47:13.825278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13405): Terminated: ok {rc=0} 20:47:13.869123 --- ParallelTerminationStrategy: PID 13408 died... 20:47:13.887481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13408): Terminated: ok {rc=0} 20:47:13.970938 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:47:15.277823 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:47:15.284529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:47:15.318217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:47:15.357442 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:47:15.445521 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:47:15.478209 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:47:15.517396 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:47:16.149197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:47:16.202731 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.214865 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:16.286805 tst cs_paging_gprs_active.py: using LAC 23622 20:47:16.415135 tst cs_paging_gprs_active.py: using RAC 162 20:47:16.578542 tst cs_paging_gprs_active.py: using CellId 23622 20:47:16.706838 tst cs_paging_gprs_active.py: using BVCI 23623 20:47:16.820593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.832436 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.844112 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.857221 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.871165 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.882947 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.895448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.909311 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:16.923565 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:17.045909 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:17.180355 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:47:17.383876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:17.686804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13413): Launched 20:47:17.947922 run iperf3-srv_10.42.42.10(pid=13414): Launched 20:47:18.060250 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:47:18.262244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:18.563604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13415): Launched 20:47:18.824194 run iperf3-srv_10.42.42.10(pid=13416): Launched 20:47:18.936692 tst cs_paging_gprs_active.py:38: start network... 20:47:19.139231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:19.604573 run create_hlr_db(pid=13417): Launched 20:47:19.720580 bus /gobi_6: Setting Powered False 20:47:20.784586 run create_hlr_db(pid=13417): Terminated: ok {rc=0} 20:47:21.213899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Launched 20:47:21.514875 run osmo-hlr_10.42.42.2(pid=13420): Launched 20:47:21.628824 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:22.161367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Launched 20:47:22.460897 run osmo-stp_10.42.42.5(pid=13423): Launched 20:47:22.575322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:23.092650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Launched 20:47:23.206994 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:23.462908 run patchelf(pid=13426): Launched 20:47:23.629190 run osmo-stp_10.42.42.5(pid=13423): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] 20:47:23.756351 run osmo-stp_10.42.42.5(pid=13423): stdout: | (launched: 2022-12-09_20:47:22.406012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:23.884743 run osmo-stp_10.42.42.5(pid=13423): stderr: | 20221209204722575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204722575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204722575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204722576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204722576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204722576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204722576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:24.013547 run osmo-stp_10.42.42.5(pid=13423): stdout: | (launched: 2022-12-09_20:47:22.406012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:24.136376 run osmo-stp_10.42.42.5(pid=13423): stderr: | 20221209204722575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204722575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204722575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204722576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204722576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204722576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204722576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:24.282483 run patchelf(pid=13426): Terminating (SIGINT) 20:47:24.451637 run patchelf(pid=13426): Terminated: ok {rc=0} 20:47:24.573357 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13423): Process ended prematurely: osmo-stp_10.42.42.5(pid=13423) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:47:24.583032 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 20:47:24.610718 run osmo-hlr_10.42.42.2(pid=13420): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13420)] 20:47:24.658234 run osmo-hlr_10.42.42.2(pid=13420): stdout: | (launched: 2022-12-09_20:47:21.459101) 20:47:24.707267 run osmo-hlr_10.42.42.2(pid=13420): stderr: | 20221209204721634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204721634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204721634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204721634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204721634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204721635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204721647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204721657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204721657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204721657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:24.757516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13413): Terminating (SIGTERM) 20:47:24.796923 run iperf3-srv_10.42.42.10(pid=13414): Terminating (SIGTERM) 20:47:24.836318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13415): Terminating (SIGTERM) 20:47:24.875938 run iperf3-srv_10.42.42.10(pid=13416): Terminating (SIGTERM) 20:47:24.915121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Terminating (SIGTERM) 20:47:24.954683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Terminating (SIGTERM) 20:47:24.993950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Terminating (SIGTERM) 20:47:25.033572 --- ParallelTerminationStrategy: PID 13413 died... 20:47:25.052399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13413): Terminated: ok {rc=0} 20:47:25.096556 --- ParallelTerminationStrategy: PID 13414 died... 20:47:25.115104 run iperf3-srv_10.42.42.10(pid=13414): Terminated {rc=256} 20:47:25.159160 --- ParallelTerminationStrategy: PID 13415 died... 20:47:25.177632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13415): Terminated: ok {rc=0} 20:47:25.221420 --- ParallelTerminationStrategy: PID 13416 died... 20:47:25.239848 run iperf3-srv_10.42.42.10(pid=13416): Terminated {rc=256} 20:47:25.283472 --- ParallelTerminationStrategy: PID 13419 died... 20:47:25.301938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13419): Terminated: ok {rc=0} 20:47:25.346012 --- ParallelTerminationStrategy: PID 13422 died... 20:47:25.364412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13422): Terminated: ok {rc=0} 20:47:25.408583 --- ParallelTerminationStrategy: PID 13425 died... 20:47:25.427117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13425): Terminated: ok {rc=0} 20:47:25.513839 bus /gobi_0: Setting Powered False 20:47:26.611820 bus /gobi_0: Setting Powered False 20:47:27.727101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:47:28.874204 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:28.886327 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:28.957571 tst iperf3.py: using LAC 23623 20:47:29.080594 tst iperf3.py: using RAC 163 20:47:29.198217 tst iperf3.py: using CellId 23623 20:47:29.315788 tst iperf3.py: using BVCI 23624 20:47:29.434621 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.446139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.457470 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.468696 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.479897 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.491441 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.503208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.514286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:29.525773 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:29.645696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:47:29.861738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:30.181988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Launched 20:47:30.459680 run iperf3-srv_10.42.42.10(pid=13428): Launched 20:47:30.580243 tst iperf3.py:8: start network... 20:47:30.796284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:31.311152 run create_hlr_db(pid=13429): Launched 20:47:31.468929 bus /gobi_6: Setting Powered False 20:47:32.533535 run create_hlr_db(pid=13429): Terminated: ok {rc=0} 20:47:32.961630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Launched 20:47:33.261439 run osmo-hlr_10.42.42.2(pid=13432): Launched 20:47:33.376073 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:33.913315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13434): Launched 20:47:34.235083 run osmo-stp_10.42.42.5(pid=13435): Launched 20:47:34.356679 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:34.909469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13437): Launched 20:47:35.031005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:35.302156 run patchelf(pid=13438): Launched 20:47:35.479657 run osmo-stp_10.42.42.5(pid=13435): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13435)] 20:47:35.615560 run osmo-stp_10.42.42.5(pid=13435): stdout: | (launched: 2022-12-09_20:47:34.176627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:35.752522 run osmo-stp_10.42.42.5(pid=13435): stderr: | 20221209204734368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204734368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204734368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204734369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204734369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204734369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204734369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:35.890651 run osmo-stp_10.42.42.5(pid=13435): stdout: | (launched: 2022-12-09_20:47:34.176627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:36.021553 run osmo-stp_10.42.42.5(pid=13435): stderr: | 20221209204734368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204734368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204734368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204734369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204734369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204734369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204734369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:36.177179 run patchelf(pid=13438): Terminating (SIGINT) 20:47:36.356083 run patchelf(pid=13438): Terminated: ok {rc=0} 20:47:36.485594 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13435): Process ended prematurely: osmo-stp_10.42.42.5(pid=13435) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13435)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 20:47:36.495690 tst iperf3.py:8: Test FAILED (7.7 sec) 20:47:36.524235 run osmo-hlr_10.42.42.2(pid=13432): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13432)] 20:47:36.573803 run osmo-hlr_10.42.42.2(pid=13432): stdout: | (launched: 2022-12-09_20:47:33.206561) 20:47:36.624916 run osmo-hlr_10.42.42.2(pid=13432): stderr: | 20221209204733383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204733383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204733383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204733383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204733383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204733383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204733396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204733406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204733406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204733406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:36.676618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Terminating (SIGTERM) 20:47:36.717794 run iperf3-srv_10.42.42.10(pid=13428): Terminating (SIGTERM) 20:47:36.759292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Terminating (SIGTERM) 20:47:36.800883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13434): Terminating (SIGTERM) 20:47:36.842511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13437): Terminating (SIGTERM) 20:47:36.884287 --- ParallelTerminationStrategy: PID 13427 died... 20:47:36.904123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13427): Terminated: ok {rc=0} 20:47:36.950828 --- ParallelTerminationStrategy: PID 13428 died... 20:47:36.970289 run iperf3-srv_10.42.42.10(pid=13428): Terminated {rc=256} 20:47:37.016219 --- ParallelTerminationStrategy: PID 13431 died... 20:47:37.035647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13431): Terminated: ok {rc=0} 20:47:37.081370 --- ParallelTerminationStrategy: PID 13434 died... 20:47:37.100648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13434): Terminated: ok {rc=0} 20:47:37.146543 --- ParallelTerminationStrategy: PID 13437 died... 20:47:37.166346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13437): Terminated: ok {rc=0} 20:47:37.253873 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:47:38.403985 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:38.415562 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:38.489272 tst iperf3m4.py: using LAC 23624 20:47:38.608694 tst iperf3m4.py: using RAC 164 20:47:38.724856 tst iperf3m4.py: using CellId 23624 20:47:38.843358 tst iperf3m4.py: using BVCI 23625 20:47:38.953226 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:38.964042 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:38.974665 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:38.985609 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:38.996356 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:39.007237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:39.018269 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:39.029167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:39.040397 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:39.161489 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:39.278467 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:39.399591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:39.522501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:47:39.723553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:40.032692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13442): Launched 20:47:40.311861 run iperf3-srv_10.42.42.10(pid=13443): Launched 20:47:40.431808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:47:40.648404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:40.970351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13444): Launched 20:47:41.248490 run iperf3-srv_10.42.42.10(pid=13445): Launched 20:47:41.368381 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:47:41.584580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:41.906204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13446): Launched 20:47:42.184060 run iperf3-srv_10.42.42.10(pid=13447): Launched 20:47:42.303409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:47:42.518941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:47:42.840327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13448): Launched 20:47:43.118162 run iperf3-srv_10.42.42.10(pid=13449): Launched 20:47:43.237062 tst iperf3m4.py:8: start network... 20:47:43.452416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:47:43.951592 run create_hlr_db(pid=13450): Launched 20:47:44.081204 bus /gobi_6: Setting Powered False 20:47:45.144340 run create_hlr_db(pid=13450): Terminated: ok {rc=0} 20:47:45.572930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Launched 20:47:45.909736 run osmo-hlr_10.42.42.2(pid=13453): Launched 20:47:46.137272 run osmo-stp_10.42.42.5: Starting osmo-stp 20:47:46.821557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Launched 20:47:47.159893 run osmo-stp_10.42.42.5(pid=13456): Launched 20:47:47.415282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:47:47.965869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Launched 20:47:48.087283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:47:48.358138 run patchelf(pid=13459): Launched 20:47:48.536312 run osmo-stp_10.42.42.5(pid=13456): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] 20:47:48.671735 run osmo-stp_10.42.42.5(pid=13456): stdout: | (launched: 2022-12-09_20:47:47.098645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:48.808839 run osmo-stp_10.42.42.5(pid=13456): stderr: | 20221209204747288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204747288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204747288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204747289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204747289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204747289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204747289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:48.945837 run osmo-stp_10.42.42.5(pid=13456): stdout: | (launched: 2022-12-09_20:47:47.098645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:47:49.077574 run osmo-stp_10.42.42.5(pid=13456): stderr: | 20221209204747288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204747288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204747288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204747289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204747289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204747289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204747289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:47:49.233443 run patchelf(pid=13459): Terminating (SIGINT) 20:47:49.413276 run patchelf(pid=13459): Terminated: ok {rc=0} 20:47:49.542703 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13456): Process ended prematurely: osmo-stp_10.42.42.5(pid=13456) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:47:49.552997 tst iperf3m4.py:8: Test FAILED (11.2 sec) 20:47:49.581958 run osmo-hlr_10.42.42.2(pid=13453): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13453)] 20:47:49.631506 run osmo-hlr_10.42.42.2(pid=13453): stdout: | (launched: 2022-12-09_20:47:45.818000) 20:47:49.682524 run osmo-hlr_10.42.42.2(pid=13453): stderr: | 20221209204746056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204746056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204746056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204746056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204746056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204746056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204746071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204746091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204746091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204746091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:47:49.734221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13442): Terminating (SIGTERM) 20:47:49.775633 run iperf3-srv_10.42.42.10(pid=13443): Terminating (SIGTERM) 20:47:49.817145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13444): Terminating (SIGTERM) 20:47:49.858466 run iperf3-srv_10.42.42.10(pid=13445): Terminating (SIGTERM) 20:47:49.899650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13446): Terminating (SIGTERM) 20:47:49.940911 run iperf3-srv_10.42.42.10(pid=13447): Terminating (SIGTERM) 20:47:49.982139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13448): Terminating (SIGTERM) 20:47:50.023408 run iperf3-srv_10.42.42.10(pid=13449): Terminating (SIGTERM) 20:47:50.064393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Terminating (SIGTERM) 20:47:50.105664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Terminating (SIGTERM) 20:47:50.146972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Terminating (SIGTERM) 20:47:50.188625 --- ParallelTerminationStrategy: PID 13442 died... 20:47:50.208523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13442): Terminated: ok {rc=0} 20:47:50.253967 --- ParallelTerminationStrategy: PID 13443 died... 20:47:50.273164 run iperf3-srv_10.42.42.10(pid=13443): Terminated {rc=256} 20:47:50.318961 --- ParallelTerminationStrategy: PID 13444 died... 20:47:50.338213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13444): Terminated: ok {rc=0} 20:47:50.383479 --- ParallelTerminationStrategy: PID 13445 died... 20:47:50.402611 run iperf3-srv_10.42.42.10(pid=13445): Terminated {rc=256} 20:47:50.447831 --- ParallelTerminationStrategy: PID 13446 died... 20:47:50.467126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13446): Terminated: ok {rc=0} 20:47:50.512685 --- ParallelTerminationStrategy: PID 13447 died... 20:47:50.531924 run iperf3-srv_10.42.42.10(pid=13447): Terminated {rc=256} 20:47:50.577383 --- ParallelTerminationStrategy: PID 13448 died... 20:47:50.596578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13448): Terminated: ok {rc=0} 20:47:50.641947 --- ParallelTerminationStrategy: PID 13449 died... 20:47:50.661156 run iperf3-srv_10.42.42.10(pid=13449): Terminated {rc=256} 20:47:50.706298 --- ParallelTerminationStrategy: PID 13452 died... 20:47:50.725566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13452): Terminated: ok {rc=0} 20:47:50.770972 --- ParallelTerminationStrategy: PID 13455 died... 20:47:50.790300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13455): Terminated: ok {rc=0} 20:47:50.835622 --- ParallelTerminationStrategy: PID 13458 died... 20:47:50.854957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13458): Terminated: ok {rc=0} 20:47:50.942179 bus /gobi_4: Setting Powered False 20:47:52.041401 bus /gobi_4: Setting Powered False 20:47:53.158860 bus /gobi_1: Setting Powered False 20:47:54.256539 bus /gobi_1: Setting Powered False 20:47:55.371031 bus /gobi_0: Setting Powered False 20:47:56.468527 bus /gobi_0: Setting Powered False 20:47:57.583004 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:47:58.686525 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:58.698051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:47:58.767811 tst ping.py: using LAC 23625 20:47:58.885392 tst ping.py: using RAC 165 20:47:59.001663 tst ping.py: using CellId 23625 20:47:59.117415 tst ping.py: using BVCI 23626 20:47:59.233562 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.244833 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.256176 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.267447 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.278707 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.290062 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.301438 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:47:59.312606 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:47:59.426206 tst ping.py:19: start network... 20:47:59.622658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:00.081320 run create_hlr_db(pid=13460): Launched 20:48:00.193885 bus /gobi_6: Setting Powered False 20:48:01.251577 run create_hlr_db(pid=13460): Terminated: ok {rc=0} 20:48:01.726279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13462): Launched 20:48:02.062139 run osmo-hlr_10.42.42.2(pid=13463): Launched 20:48:02.199478 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:02.742506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13465): Launched 20:48:03.055501 run osmo-stp_10.42.42.5(pid=13466): Launched 20:48:03.175084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:03.721295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13468): Launched 20:48:03.840384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:04.105454 run patchelf(pid=13469): Launched 20:48:04.279131 run osmo-stp_10.42.42.5(pid=13466): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13466)] 20:48:04.411835 run osmo-stp_10.42.42.5(pid=13466): stdout: | (launched: 2022-12-09_20:48:02.998165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:04.546878 run osmo-stp_10.42.42.5(pid=13466): stderr: | 20221209204803190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204803191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204803191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204803191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204803194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204803194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204803194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:04.681726 run osmo-stp_10.42.42.5(pid=13466): stdout: | (launched: 2022-12-09_20:48:02.998165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:04.810155 run osmo-stp_10.42.42.5(pid=13466): stderr: | 20221209204803190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204803191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204803191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204803191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204803194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204803194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204803194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:04.962287 run patchelf(pid=13469): Terminating (SIGINT) 20:48:05.138632 run patchelf(pid=13469): Terminated: ok {rc=0} 20:48:05.265412 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13466): Process ended prematurely: osmo-stp_10.42.42.5(pid=13466) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13466)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 20:48:05.274857 tst ping.py:22: Test FAILED (6.6 sec) 20:48:05.302717 run osmo-hlr_10.42.42.2(pid=13463): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13463)] 20:48:05.352618 run osmo-hlr_10.42.42.2(pid=13463): stdout: | (launched: 2022-12-09_20:48:01.998595) 20:48:05.404037 run osmo-hlr_10.42.42.2(pid=13463): stderr: | 20221209204802263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204802263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204802264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204802264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204802264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204802264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204802278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204802286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204802286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204802286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:05.455972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13462): Terminating (SIGTERM) 20:48:05.497186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13465): Terminating (SIGTERM) 20:48:05.538726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13468): Terminating (SIGTERM) 20:48:05.580286 --- ParallelTerminationStrategy: PID 13462 died... 20:48:05.600138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13462): Terminated: ok {rc=0} 20:48:05.646189 --- ParallelTerminationStrategy: PID 13465 died... 20:48:05.665514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13465): Terminated: ok {rc=0} 20:48:05.711070 --- ParallelTerminationStrategy: PID 13468 died... 20:48:05.730769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13468): Terminated: ok {rc=0} 20:48:05.817473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:48:06.904782 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:06.916589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:48:06.989660 tst ping_idle_ping.py: using LAC 23626 20:48:07.109298 tst ping_idle_ping.py: using RAC 166 20:48:07.226168 tst ping_idle_ping.py: using CellId 23626 20:48:07.344805 tst ping_idle_ping.py: using BVCI 23627 20:48:07.453548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.464440 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.475353 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.486974 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.498646 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.510321 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.521900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:48:07.533238 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:48:07.650144 tst ping_idle_ping.py:24: start network... 20:48:07.847842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:08.304502 run create_hlr_db(pid=13470): Launched 20:48:08.415759 bus /gobi_6: Setting Powered False 20:48:09.473807 run create_hlr_db(pid=13470): Terminated: ok {rc=0} 20:48:09.906154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13472): Launched 20:48:10.222241 run osmo-hlr_10.42.42.2(pid=13473): Launched 20:48:10.342726 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:10.886369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13475): Launched 20:48:11.202916 run osmo-stp_10.42.42.5(pid=13476): Launched 20:48:11.323109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:11.879600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13478): Launched 20:48:11.999683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:12.266942 run patchelf(pid=13479): Launched 20:48:12.442117 run osmo-stp_10.42.42.5(pid=13476): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13476)] 20:48:12.576356 run osmo-stp_10.42.42.5(pid=13476): stdout: | (launched: 2022-12-09_20:48:11.145250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.711603 run osmo-stp_10.42.42.5(pid=13476): stderr: | 20221209204811335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204811336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204811336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204811336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204811337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204811337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204811337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:12.846976 run osmo-stp_10.42.42.5(pid=13476): stdout: | (launched: 2022-12-09_20:48:11.145250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:12.976378 run osmo-stp_10.42.42.5(pid=13476): stderr: | 20221209204811335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204811336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204811336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204811336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204811337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204811337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204811337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:13.129716 run patchelf(pid=13479): Terminating (SIGINT) 20:48:13.306734 run patchelf(pid=13479): Terminated: ok {rc=0} 20:48:13.435003 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13476): Process ended prematurely: osmo-stp_10.42.42.5(pid=13476) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13476)] [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:48:13.444463 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:48:13.473198 run osmo-hlr_10.42.42.2(pid=13473): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13473)] 20:48:13.523039 run osmo-hlr_10.42.42.2(pid=13473): stdout: | (launched: 2022-12-09_20:48:10.164404) 20:48:13.574428 run osmo-hlr_10.42.42.2(pid=13473): stderr: | 20221209204810361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204810361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204810361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204810361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204810361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204810361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204810373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204810381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204810381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204810381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:13.626162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13472): Terminating (SIGTERM) 20:48:13.667329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13475): Terminating (SIGTERM) 20:48:13.708686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13478): Terminating (SIGTERM) 20:48:13.750305 --- ParallelTerminationStrategy: PID 13472 died... 20:48:13.770126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13472): Terminated: ok {rc=0} 20:48:13.815615 --- ParallelTerminationStrategy: PID 13475 died... 20:48:13.834981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13475): Terminated: ok {rc=0} 20:48:13.880719 --- ParallelTerminationStrategy: PID 13478 died... 20:48:13.900221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13478): Terminated: ok {rc=0} 20:48:13.987322 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 20:48:15.292065 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:48:15.299800 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 20:48:15.333155 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 20:48:15.371724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 20:48:15.456829 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 20:48:15.489591 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 20:48:15.528151 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 20:48:16.135810 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 20:48:16.188552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.200724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:16.253780 tst cs_paging_gprs_active.py: using LAC 23627 20:48:16.375650 tst cs_paging_gprs_active.py: using RAC 167 20:48:16.505136 tst cs_paging_gprs_active.py: using CellId 23627 20:48:16.657449 tst cs_paging_gprs_active.py: using BVCI 23628 20:48:16.815400 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.829617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.843122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.856595 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.868844 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.882074 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.895190 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.909456 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:16.923296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:17.051234 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:17.178291 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:48:17.397723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:17.721424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13483): Launched 20:48:18.000566 run iperf3-srv_10.42.42.10(pid=13484): Launched 20:48:18.120541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:48:18.337797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:18.660856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13485): Launched 20:48:18.939655 run iperf3-srv_10.42.42.10(pid=13486): Launched 20:48:19.059596 tst cs_paging_gprs_active.py:38: start network... 20:48:19.276147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:19.774078 run create_hlr_db(pid=13487): Launched 20:48:19.903723 bus /gobi_6: Setting Powered False 20:48:20.966674 run create_hlr_db(pid=13487): Terminated: ok {rc=0} 20:48:21.394670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13489): Launched 20:48:21.695326 run osmo-hlr_10.42.42.2(pid=13490): Launched 20:48:21.809638 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:22.338751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13492): Launched 20:48:22.637144 run osmo-stp_10.42.42.5(pid=13493): Launched 20:48:22.750908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:23.267758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13495): Launched 20:48:23.381924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:23.635498 run patchelf(pid=13496): Launched 20:48:23.801508 run osmo-stp_10.42.42.5(pid=13493): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13493)] 20:48:23.928249 run osmo-stp_10.42.42.5(pid=13493): stdout: | (launched: 2022-12-09_20:48:22.582258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:24.057073 run osmo-stp_10.42.42.5(pid=13493): stderr: | 20221209204822753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204822753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204822753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204822754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204822755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204822755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204822755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.185198 run osmo-stp_10.42.42.5(pid=13493): stdout: | (launched: 2022-12-09_20:48:22.582258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:24.307604 run osmo-stp_10.42.42.5(pid=13493): stderr: | 20221209204822753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204822753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204822753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204822754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204822755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204822755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204822755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:24.453462 run patchelf(pid=13496): Terminating (SIGINT) 20:48:24.621863 run patchelf(pid=13496): Terminated: ok {rc=0} 20:48:24.743308 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13493): Process ended prematurely: osmo-stp_10.42.42.5(pid=13493) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13493)] [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 20:48:24.752868 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 20:48:24.780213 run osmo-hlr_10.42.42.2(pid=13490): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13490)] 20:48:24.827451 run osmo-hlr_10.42.42.2(pid=13490): stdout: | (launched: 2022-12-09_20:48:21.640261) 20:48:24.876843 run osmo-hlr_10.42.42.2(pid=13490): stderr: | 20221209204821815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204821815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204821815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204821815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204821815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204821815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204821830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204821841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204821841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204821842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:24.926601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13483): Terminating (SIGTERM) 20:48:24.966023 run iperf3-srv_10.42.42.10(pid=13484): Terminating (SIGTERM) 20:48:25.005372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13485): Terminating (SIGTERM) 20:48:25.045133 run iperf3-srv_10.42.42.10(pid=13486): Terminating (SIGTERM) 20:48:25.084308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13489): Terminating (SIGTERM) 20:48:25.123732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13492): Terminating (SIGTERM) 20:48:25.162984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13495): Terminating (SIGTERM) 20:48:25.202505 --- ParallelTerminationStrategy: PID 13483 died... 20:48:25.221286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13483): Terminated: ok {rc=0} 20:48:25.265269 --- ParallelTerminationStrategy: PID 13484 died... 20:48:25.283527 run iperf3-srv_10.42.42.10(pid=13484): Terminated {rc=256} 20:48:25.326962 --- ParallelTerminationStrategy: PID 13485 died... 20:48:25.345162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13485): Terminated: ok {rc=0} 20:48:25.388275 --- ParallelTerminationStrategy: PID 13486 died... 20:48:25.406457 run iperf3-srv_10.42.42.10(pid=13486): Terminated {rc=256} 20:48:25.449671 --- ParallelTerminationStrategy: PID 13489 died... 20:48:25.467917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13489): Terminated: ok {rc=0} 20:48:25.511662 --- ParallelTerminationStrategy: PID 13492 died... 20:48:25.529816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13492): Terminated: ok {rc=0} 20:48:25.573648 --- ParallelTerminationStrategy: PID 13495 died... 20:48:25.591809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13495): Terminated: ok {rc=0} 20:48:25.674444 bus /gobi_0: Setting Powered False 20:48:26.769418 bus /gobi_0: Setting Powered False 20:48:27.884468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 20:48:29.031538 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.043934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:29.098625 tst iperf3.py: using LAC 23628 20:48:29.225568 tst iperf3.py: using RAC 168 20:48:29.350372 tst iperf3.py: using CellId 23628 20:48:29.474302 tst iperf3.py: using BVCI 23629 20:48:29.591749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.603592 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.615104 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.626615 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.638156 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.649600 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.661241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.672594 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:29.684285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:29.799013 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:48:30.000527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:30.302032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Launched 20:48:30.563149 run iperf3-srv_10.42.42.10(pid=13498): Launched 20:48:30.675717 tst iperf3.py:8: start network... 20:48:30.881718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:31.422507 run create_hlr_db(pid=13499): Launched 20:48:31.610442 bus /gobi_6: Setting Powered False 20:48:32.670189 run create_hlr_db(pid=13499): Terminated: ok {rc=0} 20:48:33.107867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13501): Launched 20:48:33.428155 run osmo-hlr_10.42.42.2(pid=13502): Launched 20:48:33.551799 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:34.105870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13504): Launched 20:48:34.424834 run osmo-stp_10.42.42.5(pid=13505): Launched 20:48:34.546848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:35.099443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13507): Launched 20:48:35.221769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:35.492208 run patchelf(pid=13508): Launched 20:48:35.671082 run osmo-stp_10.42.42.5(pid=13505): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13505)] 20:48:35.806715 run osmo-stp_10.42.42.5(pid=13505): stdout: | (launched: 2022-12-09_20:48:34.366508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:35.944076 run osmo-stp_10.42.42.5(pid=13505): stderr: | 20221209204834559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204834559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204834560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204834560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204834561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204834561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204834561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:36.081490 run osmo-stp_10.42.42.5(pid=13505): stdout: | (launched: 2022-12-09_20:48:34.366508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:36.213115 run osmo-stp_10.42.42.5(pid=13505): stderr: | 20221209204834559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204834559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204834560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204834560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204834561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204834561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204834561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:36.368924 run patchelf(pid=13508): Terminating (SIGINT) 20:48:36.549110 run patchelf(pid=13508): Terminated: ok {rc=0} 20:48:36.679415 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13505): Process ended prematurely: osmo-stp_10.42.42.5(pid=13505) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13505)] [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 20:48:36.689724 tst iperf3.py:8: Test FAILED (7.7 sec) 20:48:36.718045 run osmo-hlr_10.42.42.2(pid=13502): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13502)] 20:48:36.767635 run osmo-hlr_10.42.42.2(pid=13502): stdout: | (launched: 2022-12-09_20:48:33.369801) 20:48:36.818863 run osmo-hlr_10.42.42.2(pid=13502): stderr: | 20221209204833570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204833570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204833570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204833570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204833570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204833570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204833583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204833591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204833591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204833591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:36.870615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Terminating (SIGTERM) 20:48:36.911860 run iperf3-srv_10.42.42.10(pid=13498): Terminating (SIGTERM) 20:48:36.953158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13501): Terminating (SIGTERM) 20:48:36.994645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13504): Terminating (SIGTERM) 20:48:37.035896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13507): Terminating (SIGTERM) 20:48:37.077295 --- ParallelTerminationStrategy: PID 13497 died... 20:48:37.096797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13497): Terminated: ok {rc=0} 20:48:37.142336 --- ParallelTerminationStrategy: PID 13498 died... 20:48:37.161539 run iperf3-srv_10.42.42.10(pid=13498): Terminated {rc=256} 20:48:37.206826 --- ParallelTerminationStrategy: PID 13501 died... 20:48:37.226014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13501): Terminated: ok {rc=0} 20:48:37.271255 --- ParallelTerminationStrategy: PID 13504 died... 20:48:37.290472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13504): Terminated: ok {rc=0} 20:48:37.335748 --- ParallelTerminationStrategy: PID 13507 died... 20:48:37.355092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13507): Terminated: ok {rc=0} 20:48:37.441878 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 20:48:38.589723 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:38.601693 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:38.654928 tst iperf3m4.py: using LAC 23629 20:48:38.776100 tst iperf3m4.py: using RAC 169 20:48:38.893035 tst iperf3m4.py: using CellId 23629 20:48:39.009388 tst iperf3m4.py: using BVCI 23630 20:48:39.118528 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.130042 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.141066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.152352 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.163767 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.174700 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.185983 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.196707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:39.208836 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:39.324928 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:39.448619 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:39.565345 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:39.684436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:48:39.900276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:40.221221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13509): Launched 20:48:40.498659 run iperf3-srv_10.42.42.10(pid=13510): Launched 20:48:40.618318 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:48:40.833648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:41.154081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13511): Launched 20:48:41.430719 run iperf3-srv_10.42.42.10(pid=13512): Launched 20:48:41.550139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:48:41.765874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:42.086599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Launched 20:48:42.364333 run iperf3-srv_10.42.42.10(pid=13514): Launched 20:48:42.483106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:48:42.698476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:48:43.018910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13515): Launched 20:48:43.296059 run iperf3-srv_10.42.42.10(pid=13516): Launched 20:48:43.415471 tst iperf3m4.py:8: start network... 20:48:43.631408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:48:44.131574 run create_hlr_db(pid=13517): Launched 20:48:44.253642 bus /gobi_6: Setting Powered False 20:48:45.313817 run create_hlr_db(pid=13517): Terminated: ok {rc=0} 20:48:45.733107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13519): Launched 20:48:46.097915 run osmo-hlr_10.42.42.2(pid=13520): Launched 20:48:46.296318 run osmo-stp_10.42.42.5: Starting osmo-stp 20:48:46.933787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13522): Launched 20:48:47.303583 run osmo-stp_10.42.42.5(pid=13523): Launched 20:48:47.434604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:48:47.996824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13525): Launched 20:48:48.119739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:48:48.390975 run patchelf(pid=13526): Launched 20:48:48.569630 run osmo-stp_10.42.42.5(pid=13523): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13523)] 20:48:48.705404 run osmo-stp_10.42.42.5(pid=13523): stdout: | (launched: 2022-12-09_20:48:47.240046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:48.842945 run osmo-stp_10.42.42.5(pid=13523): stderr: | 20221209204847475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204847475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204847475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204847476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204847476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204847476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204847476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:48.980156 run osmo-stp_10.42.42.5(pid=13523): stdout: | (launched: 2022-12-09_20:48:47.240046) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:48:49.111904 run osmo-stp_10.42.42.5(pid=13523): stderr: | 20221209204847475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204847475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204847475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204847476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204847476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204847476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204847476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:48:49.267597 run patchelf(pid=13526): Terminating (SIGINT) 20:48:49.447111 run patchelf(pid=13526): Terminated: ok {rc=0} 20:48:49.577217 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13523): Process ended prematurely: osmo-stp_10.42.42.5(pid=13523) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13523)] [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 20:48:49.587628 tst iperf3m4.py:8: Test FAILED (11.0 sec) 20:48:49.616289 run osmo-hlr_10.42.42.2(pid=13520): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13520)] 20:48:49.665865 run osmo-hlr_10.42.42.2(pid=13520): stdout: | (launched: 2022-12-09_20:48:46.012075) 20:48:49.717219 run osmo-hlr_10.42.42.2(pid=13520): stderr: | 20221209204846379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204846379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204846380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204846380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204846380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204846380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204846400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204846425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204846426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204846426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:48:49.769204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13509): Terminating (SIGTERM) 20:48:49.810517 run iperf3-srv_10.42.42.10(pid=13510): Terminating (SIGTERM) 20:48:49.851683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13511): Terminating (SIGTERM) 20:48:49.892703 run iperf3-srv_10.42.42.10(pid=13512): Terminating (SIGTERM) 20:48:49.933692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Terminating (SIGTERM) 20:48:49.974877 run iperf3-srv_10.42.42.10(pid=13514): Terminating (SIGTERM) 20:48:50.015977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13515): Terminating (SIGTERM) 20:48:50.057183 run iperf3-srv_10.42.42.10(pid=13516): Terminating (SIGTERM) 20:48:50.098277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13519): Terminating (SIGTERM) 20:48:50.139377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13522): Terminating (SIGTERM) 20:48:50.180275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13525): Terminating (SIGTERM) 20:48:50.221847 --- ParallelTerminationStrategy: PID 13509 died... 20:48:50.241494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13509): Terminated: ok {rc=0} 20:48:50.286952 --- ParallelTerminationStrategy: PID 13510 died... 20:48:50.306227 run iperf3-srv_10.42.42.10(pid=13510): Terminated {rc=256} 20:48:50.351570 --- ParallelTerminationStrategy: PID 13511 died... 20:48:50.370906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13511): Terminated: ok {rc=0} 20:48:50.416177 --- ParallelTerminationStrategy: PID 13512 died... 20:48:50.435485 run iperf3-srv_10.42.42.10(pid=13512): Terminated {rc=256} 20:48:50.480671 --- ParallelTerminationStrategy: PID 13513 died... 20:48:50.499976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13513): Terminated: ok {rc=0} 20:48:50.545564 --- ParallelTerminationStrategy: PID 13514 died... 20:48:50.564670 run iperf3-srv_10.42.42.10(pid=13514): Terminated {rc=256} 20:48:50.610126 --- ParallelTerminationStrategy: PID 13515 died... 20:48:50.629376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13515): Terminated: ok {rc=0} 20:48:50.674527 --- ParallelTerminationStrategy: PID 13516 died... 20:48:50.693801 run iperf3-srv_10.42.42.10(pid=13516): Terminated {rc=256} 20:48:50.738881 --- ParallelTerminationStrategy: PID 13519 died... 20:48:50.758423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13519): Terminated: ok {rc=0} 20:48:50.803721 --- ParallelTerminationStrategy: PID 13522 died... 20:48:50.823119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13522): Terminated: ok {rc=0} 20:48:50.868476 --- ParallelTerminationStrategy: PID 13525 died... 20:48:50.887889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13525): Terminated: ok {rc=0} 20:48:50.974279 bus /gobi_4: Setting Powered False 20:48:52.072876 bus /gobi_4: Setting Powered False 20:48:53.188429 bus /gobi_1: Setting Powered False 20:48:54.286176 bus /gobi_1: Setting Powered False 20:48:55.401378 bus /gobi_0: Setting Powered False 20:48:56.498776 bus /gobi_0: Setting Powered False 20:48:57.614412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 20:48:58.713396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:58.725261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:48:58.777092 tst ping.py: using LAC 23630 20:48:58.894763 tst ping.py: using RAC 170 20:48:59.010947 tst ping.py: using CellId 23630 20:48:59.126632 tst ping.py: using BVCI 23631 20:48:59.235091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.246458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.257559 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.268785 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.280070 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.291377 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.302817 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:48:59.314212 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:48:59.431297 tst ping.py:19: start network... 20:48:59.645327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:00.133572 run create_hlr_db(pid=13527): Launched 20:49:00.262093 bus /gobi_6: Setting Powered False 20:49:01.319826 run create_hlr_db(pid=13527): Terminated: ok {rc=0} 20:49:01.789492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13529): Launched 20:49:02.112709 run osmo-hlr_10.42.42.2(pid=13530): Launched 20:49:02.258431 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:02.797775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13532): Launched 20:49:03.113920 run osmo-stp_10.42.42.5(pid=13533): Launched 20:49:03.233826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:03.779093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13535): Launched 20:49:03.899176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:04.165723 run patchelf(pid=13536): Launched 20:49:04.340282 run osmo-stp_10.42.42.5(pid=13533): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13533)] 20:49:04.473892 run osmo-stp_10.42.42.5(pid=13533): stdout: | (launched: 2022-12-09_20:49:03.056112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:04.610341 run osmo-stp_10.42.42.5(pid=13533): stderr: | 20221209204903246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204903246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204903246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204903247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204903247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204903247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204903247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:04.745448 run osmo-stp_10.42.42.5(pid=13533): stdout: | (launched: 2022-12-09_20:49:03.056112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:04.874897 run osmo-stp_10.42.42.5(pid=13533): stderr: | 20221209204903246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204903246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204903246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204903247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204903247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204903247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204903247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:05.027821 run patchelf(pid=13536): Terminating (SIGINT) 20:49:05.203962 run patchelf(pid=13536): Terminated: ok {rc=0} 20:49:05.331344 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13533): Process ended prematurely: osmo-stp_10.42.42.5(pid=13533) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13533)] [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 20:49:05.340891 tst ping.py:22: Test FAILED (6.6 sec) 20:49:05.368736 run osmo-hlr_10.42.42.2(pid=13530): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13530)] 20:49:05.418268 run osmo-hlr_10.42.42.2(pid=13530): stdout: | (launched: 2022-12-09_20:49:02.054967) 20:49:05.469377 run osmo-hlr_10.42.42.2(pid=13530): stderr: | 20221209204902332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204902332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204902332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204902332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204902332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204902332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204902344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204902352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204902353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204902353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:05.520916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13529): Terminating (SIGTERM) 20:49:05.562689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13532): Terminating (SIGTERM) 20:49:05.604176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13535): Terminating (SIGTERM) 20:49:05.645786 --- ParallelTerminationStrategy: PID 13529 died... 20:49:05.665462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13529): Terminated: ok {rc=0} 20:49:05.711327 --- ParallelTerminationStrategy: PID 13532 died... 20:49:05.730804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13532): Terminated: ok {rc=0} 20:49:05.776268 --- ParallelTerminationStrategy: PID 13535 died... 20:49:05.795720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13535): Terminated: ok {rc=0} 20:49:05.882801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 20:49:06.970437 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:06.983317 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 20:49:07.037805 tst ping_idle_ping.py: using LAC 23631 20:49:07.164892 tst ping_idle_ping.py: using RAC 171 20:49:07.282820 tst ping_idle_ping.py: using CellId 23631 20:49:07.401720 tst ping_idle_ping.py: using BVCI 23632 20:49:07.517695 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.529553 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.541050 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.552862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.564728 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.576348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.587878 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 20:49:07.599500 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 20:49:07.716063 tst ping_idle_ping.py:24: start network... 20:49:07.930054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:08.421644 run create_hlr_db(pid=13537): Launched 20:49:08.550123 bus /gobi_6: Setting Powered False 20:49:09.612255 run create_hlr_db(pid=13537): Terminated: ok {rc=0} 20:49:10.052575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Launched 20:49:10.367222 run osmo-hlr_10.42.42.2(pid=13540): Launched 20:49:10.486730 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:11.030554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Launched 20:49:11.344501 run osmo-stp_10.42.42.5(pid=13543): Launched 20:49:11.464054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:12.009705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Launched 20:49:12.129718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:12.395976 run patchelf(pid=13546): Launched 20:49:12.571138 run osmo-stp_10.42.42.5(pid=13543): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] 20:49:12.705069 run osmo-stp_10.42.42.5(pid=13543): stdout: | (launched: 2022-12-09_20:49:11.286761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:12.840475 run osmo-stp_10.42.42.5(pid=13543): stderr: | 20221209204911477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204911477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204911478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204911478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204911479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204911479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204911479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:12.975938 run osmo-stp_10.42.42.5(pid=13543): stdout: | (launched: 2022-12-09_20:49:11.286761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:13.105398 run osmo-stp_10.42.42.5(pid=13543): stderr: | 20221209204911477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204911477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204911478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204911478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204911479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204911479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204911479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:13.258524 run patchelf(pid=13546): Terminating (SIGINT) 20:49:13.435728 run patchelf(pid=13546): Terminated: ok {rc=0} 20:49:13.563833 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13543): Process ended prematurely: osmo-stp_10.42.42.5(pid=13543) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 20:49:13.573498 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 20:49:13.601477 run osmo-hlr_10.42.42.2(pid=13540): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13540)] 20:49:13.650899 run osmo-hlr_10.42.42.2(pid=13540): stdout: | (launched: 2022-12-09_20:49:10.309433) 20:49:13.701846 run osmo-hlr_10.42.42.2(pid=13540): stderr: | 20221209204910507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204910507 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204910507 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204910507 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204910507 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204910507 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204910520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204910529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204910529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204910529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:13.753474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Terminating (SIGTERM) 20:49:13.794558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Terminating (SIGTERM) 20:49:13.835717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Terminating (SIGTERM) 20:49:13.877654 --- ParallelTerminationStrategy: PID 13539 died... 20:49:13.897434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Terminated: ok {rc=0} 20:49:13.943196 --- ParallelTerminationStrategy: PID 13542 died... 20:49:13.962682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Terminated: ok {rc=0} 20:49:14.007903 --- ParallelTerminationStrategy: PID 13545 died... 20:49:14.027091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Terminated: ok {rc=0} 20:49:14.114434 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:49:15.425513 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:15.432354 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:49:15.465080 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:49:15.500032 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:49:15.555262 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:49:15.588462 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:49:15.623673 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:49:16.185927 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:49:16.194358 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.210984 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:49:16.281569 tst switch_tch_pdch.py: using LAC 23632 20:49:16.409367 tst switch_tch_pdch.py: using RAC 172 20:49:16.535572 tst switch_tch_pdch.py: using CellId 23632 20:49:16.661421 tst switch_tch_pdch.py: using BVCI 23633 20:49:16.772818 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.784895 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.798180 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.811331 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.823300 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.835828 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.849136 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:49:16.862827 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:17.007468 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:49:17.146101 tst switch_tch_pdch.py:51: start network... 20:49:17.359663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:17.848445 run create_hlr_db(pid=13553): Launched 20:49:17.976832 bus /gobi_6: Setting Powered False 20:49:19.039782 run create_hlr_db(pid=13553): Terminated: ok {rc=0} 20:49:19.461693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13555): Launched 20:49:19.756343 run osmo-hlr_10.42.42.2(pid=13556): Launched 20:49:19.868754 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:20.387486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13558): Launched 20:49:20.680636 run osmo-stp_10.42.42.5(pid=13559): Launched 20:49:20.792091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:21.299872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13561): Launched 20:49:21.412106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:21.661401 run patchelf(pid=13562): Launched 20:49:21.825082 run osmo-stp_10.42.42.5(pid=13559): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13559)] 20:49:21.950235 run osmo-stp_10.42.42.5(pid=13559): stdout: | (launched: 2022-12-09_20:49:20.626830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:22.076746 run osmo-stp_10.42.42.5(pid=13559): stderr: | 20221209204920795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204920795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204920795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204920795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204920798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204920798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204920798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:22.204023 run osmo-stp_10.42.42.5(pid=13559): stdout: | (launched: 2022-12-09_20:49:20.626830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:22.324552 run osmo-stp_10.42.42.5(pid=13559): stderr: | 20221209204920795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204920795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204920795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204920795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204920798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204920798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204920798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:22.467533 run patchelf(pid=13562): Terminating (SIGINT) 20:49:22.633153 run patchelf(pid=13562): Terminated: ok {rc=0} 20:49:22.752363 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13559): Process ended prematurely: osmo-stp_10.42.42.5(pid=13559) [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13559)] [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:49:22.761458 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 20:49:22.788009 run osmo-hlr_10.42.42.2(pid=13556): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13556)] 20:49:22.835494 run osmo-hlr_10.42.42.2(pid=13556): stdout: | (launched: 2022-12-09_20:49:19.702145) 20:49:22.884357 run osmo-hlr_10.42.42.2(pid=13556): stderr: | 20221209204919876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204919876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204919876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204919876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204919876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204919876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204919888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204919897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204919897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204919897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:22.933742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13555): Terminating (SIGTERM) 20:49:22.973067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13558): Terminating (SIGTERM) 20:49:23.012207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13561): Terminating (SIGTERM) 20:49:23.051736 --- ParallelTerminationStrategy: PID 13555 died... 20:49:23.070317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13555): Terminated: ok {rc=0} 20:49:23.113939 --- ParallelTerminationStrategy: PID 13558 died... 20:49:23.131978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13558): Terminated: ok {rc=0} 20:49:23.175297 --- ParallelTerminationStrategy: PID 13561 died... 20:49:23.193451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13561): Terminated: ok {rc=0} 20:49:23.277378 bus /gobi_0: Setting Powered False 20:49:24.378945 bus /gobi_0: Setting Powered False 20:49:25.492475 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:49:26.745223 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:26.751564 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:49:26.784358 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:49:26.819571 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:49:26.872856 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:49:26.905568 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:49:26.940431 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:49:27.497616 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:49:27.502798 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:27.514064 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:49:27.589182 tst switch_tch_pdch.py: using LAC 23633 20:49:27.711740 tst switch_tch_pdch.py: using RAC 173 20:49:27.832837 tst switch_tch_pdch.py: using CellId 23633 20:49:27.948344 tst switch_tch_pdch.py: using BVCI 23634 20:49:28.054937 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.066365 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.077292 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.088515 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.099724 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.111079 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.122497 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:49:28.133629 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:49:28.247498 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:49:28.361719 tst switch_tch_pdch.py:51: start network... 20:49:28.557931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:28.989166 run create_hlr_db(pid=13566): Launched 20:49:29.100810 bus /gobi_6: Setting Powered False 20:49:30.159644 run create_hlr_db(pid=13566): Terminated: ok {rc=0} 20:49:30.563945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Launched 20:49:30.889657 run osmo-hlr_10.42.42.2(pid=13569): Launched 20:49:31.031639 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:31.705750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Launched 20:49:32.083121 run osmo-stp_10.42.42.5(pid=13572): Launched 20:49:32.362967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:49:32.991980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Launched 20:49:33.111471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:49:33.376378 run patchelf(pid=13575): Launched 20:49:33.550443 run osmo-stp_10.42.42.5(pid=13572): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] 20:49:33.684182 run osmo-stp_10.42.42.5(pid=13572): stdout: | (launched: 2022-12-09_20:49:32.025234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:33.819192 run osmo-stp_10.42.42.5(pid=13572): stderr: | 20221209204932405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204932405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204932406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204932406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204932406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204932406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204932407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:33.954456 run osmo-stp_10.42.42.5(pid=13572): stdout: | (launched: 2022-12-09_20:49:32.025234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:34.083691 run osmo-stp_10.42.42.5(pid=13572): stderr: | 20221209204932405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204932405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204932406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204932406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204932406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204932406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204932407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:34.237337 run patchelf(pid=13575): Terminating (SIGINT) 20:49:34.413667 run patchelf(pid=13575): Terminated: ok {rc=0} 20:49:34.540682 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13572): Process ended prematurely: osmo-stp_10.42.42.5(pid=13572) [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:49:34.550441 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 20:49:34.578625 run osmo-hlr_10.42.42.2(pid=13569): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13569)] 20:49:34.628359 run osmo-hlr_10.42.42.2(pid=13569): stdout: | (launched: 2022-12-09_20:49:30.821288) 20:49:34.679623 run osmo-hlr_10.42.42.2(pid=13569): stderr: | 20221209204931161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204931161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204931161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204931161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204931161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204931162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204931179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204931208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204931208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204931208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:34.731351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Terminating (SIGTERM) 20:49:34.772885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Terminating (SIGTERM) 20:49:34.814541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Terminating (SIGTERM) 20:49:34.856416 --- ParallelTerminationStrategy: PID 13568 died... 20:49:34.876310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13568): Terminated: ok {rc=0} 20:49:34.922595 --- ParallelTerminationStrategy: PID 13571 died... 20:49:34.942070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13571): Terminated: ok {rc=0} 20:49:34.987592 --- ParallelTerminationStrategy: PID 13574 died... 20:49:35.006989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13574): Terminated: ok {rc=0} 20:49:35.093304 bus /gobi_0: Setting Powered False 20:49:36.191325 bus /gobi_0: Setting Powered False 20:49:37.308559 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:trx-lms --------------------------------------------------------------------- 20:49:38.561954 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:38.566027 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:38.599537 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 20:49:38.606492 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 20:49:38.659993 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:38.693647 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 20:49:38.700730 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 20:49:39.237852 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 20:49:39.244008 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 20:49:39.255701 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 20:49:39.308175 tst mo_mt_sms.py: using LAC 23634 20:49:39.424871 tst mo_mt_sms.py: using RAC 174 20:49:39.539478 tst mo_mt_sms.py: using CellId 23634 20:49:39.654040 tst mo_mt_sms.py: using BVCI 23635 20:49:39.763464 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:39.881521 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:39.996765 tst mo_mt_sms.py:9: start nitb and bts... 20:49:40.194756 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:49:40.793849 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13579): Launched 20:49:41.086998 run osmo-nitb_10.42.42.2(pid=13580): Launched 20:49:41.249919 run osmo-nitb_10.42.42.2(pid=13580): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13580)] 20:49:41.381787 run osmo-nitb_10.42.42.2(pid=13580): stdout: | (launched: 2022-12-09_20:49:41.032875) 20:49:41.515174 run osmo-nitb_10.42.42.2(pid=13580): stderr: | (launched: 2022-12-09_20:49:41.076561) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:41.649174 run osmo-nitb_10.42.42.2(pid=13580): stdout: | (launched: 2022-12-09_20:49:41.032875) 20:49:41.777662 run osmo-nitb_10.42.42.2(pid=13580): stderr: | (launched: 2022-12-09_20:49:41.076561) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13580): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13580) [trial-2364↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13580)] 20:49:42.198166 tst osmo-nitb_10.42.42.2(pid=13580): stdout: | (launched: 2022-12-09_20:49:41.032875) 20:49:42.317436 tst osmo-nitb_10.42.42.2(pid=13580): stderr: | (launched: 2022-12-09_20:49:41.076561) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:49:42.457107 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13580): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13580) [trial-2364↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13580)] [trial-2364↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 20:49:42.465564 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 20:49:42.472166 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13579): Terminating (SIGTERM) 20:49:42.680619 --- ParallelTerminationStrategy: PID 13579 died... 20:49:42.700897 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13579): Terminated: ok {rc=0} 20:49:42.785437 bus /sierra_3: Setting Powered False 20:49:43.883129 bus /sierra_3: Setting Powered False 20:49:44.998500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:trx-lms --------------------------------------------------------------------- 20:49:46.248630 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:46.255846 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:46.302253 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:49:46.338692 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 20:49:46.402410 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:46.450427 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:49:46.484668 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 20:49:47.023253 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 20:49:47.032570 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.044017 tst sms:trx-lms: Using 1 x bts (candidates: 1) 20:49:47.095851 tst mo_mt_sms.py: using LAC 23635 20:49:47.215152 tst mo_mt_sms.py: using RAC 175 20:49:47.341248 tst mo_mt_sms.py: using CellId 23635 20:49:47.458714 tst mo_mt_sms.py: using BVCI 23636 20:49:47.567600 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.578252 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.588763 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.599502 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.610146 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 20:49:47.620255 tst sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:47.737545 tst sms:trx-lms: Using 1 x modem (candidates: 2) 20:49:47.854370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:49:48.311845 run create_hlr_db(pid=13584): Launched 20:49:48.422465 bus /sierra_2: Setting Powered False 20:49:49.481415 run create_hlr_db(pid=13584): Terminated: ok {rc=0} 20:49:49.909934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13586): Launched 20:49:50.223283 run osmo-hlr_10.42.42.2(pid=13587): Launched 20:49:50.344110 run osmo-stp_10.42.42.5: Starting osmo-stp 20:49:50.884372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13589): Launched 20:49:51.197276 run osmo-stp_10.42.42.5(pid=13590): Launched 20:49:51.316387 run osmo-msc_10.42.42.6: Starting osmo-msc 20:49:51.885191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13592): Launched 20:49:52.199606 run osmo-msc_10.42.42.6(pid=13593): Launched 20:49:52.375169 run osmo-stp_10.42.42.5(pid=13590): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13590)] 20:49:52.507469 run osmo-stp_10.42.42.5(pid=13590): stdout: | (launched: 2022-12-09_20:49:51.140055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:52.641455 run osmo-stp_10.42.42.5(pid=13590): stderr: | 20221209204951329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204951329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204951330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204951330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204951330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204951331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204951331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:52.773446 run osmo-stp_10.42.42.5(pid=13590): stdout: | (launched: 2022-12-09_20:49:51.140055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:49:52.898777 run osmo-stp_10.42.42.5(pid=13590): stderr: | 20221209204951329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209204951329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209204951330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209204951330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209204951330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209204951331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209204951331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:49:53.048650 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13590): Process ended prematurely: osmo-stp_10.42.42.5(pid=13590) [trial-2364↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13590)] [trial-2364↪sms:trx-lms↪mo_mt_sms.py:16] 20:49:53.057843 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 20:49:53.085108 run osmo-hlr_10.42.42.2(pid=13587): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13587)] 20:49:53.134801 run osmo-hlr_10.42.42.2(pid=13587): stdout: | (launched: 2022-12-09_20:49:50.165840) 20:49:53.186133 run osmo-hlr_10.42.42.2(pid=13587): stderr: | 20221209204950362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209204950362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209204950362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209204950362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209204950362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209204950362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209204950375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209204950383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209204950383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209204950383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:49:53.258038 run osmo-msc_10.42.42.6(pid=13593): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13593)] 20:49:53.307481 run osmo-msc_10.42.42.6(pid=13593): stdout: | (launched: 2022-12-09_20:49:52.141983) 20:49:53.358462 run osmo-msc_10.42.42.6(pid=13593): stderr: | 20221209204952461 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209204952461 DLGLOBAL DEBUG validating counter group 0x7fd8eb5bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209204952461 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209204952461 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209204952462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209204952462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209204952463 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209204952464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209204952464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209204952464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:49:53.409853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13586): Terminating (SIGTERM) 20:49:53.451109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13589): Terminating (SIGTERM) 20:49:53.492268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13592): Terminating (SIGTERM) 20:49:53.534057 --- ParallelTerminationStrategy: PID 13586 died... 20:49:53.553968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13586): Terminated: ok {rc=0} 20:49:53.600106 --- ParallelTerminationStrategy: PID 13589 died... 20:49:53.619619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13589): Terminated: ok {rc=0} 20:49:53.665089 --- ParallelTerminationStrategy: PID 13592 died... 20:49:53.684410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13592): Terminated: ok {rc=0} 20:49:53.771379 bus /sierra_3: Setting Powered False 20:49:54.869032 bus /sierra_3: Setting Powered False 20:49:55.984836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-lms --------------------------------------------------------------------- 20:49:57.210531 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:49:57.215451 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 20:49:57.249458 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 20:49:57.256311 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 20:49:57.293251 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 20:49:57.326460 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 20:49:57.333305 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 20:49:57.851844 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 20:49:57.857999 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 20:49:57.869357 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 20:49:57.917749 tst assert_extension.py: using LAC 23636 20:49:58.036214 tst assert_extension.py: using RAC 176 20:49:58.156060 tst assert_extension.py: using CellId 23636 20:49:58.279456 tst assert_extension.py: using BVCI 23637 20:49:58.388136 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 20:49:58.503062 tst assert_extension.py:10: start nitb and bts... 20:49:58.715475 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:49:59.357139 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13598): Launched 20:49:59.670798 run osmo-nitb_10.42.42.2(pid=13599): Launched 20:49:59.843683 run osmo-nitb_10.42.42.2(pid=13599): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13599)] 20:49:59.983895 run osmo-nitb_10.42.42.2(pid=13599): stdout: | (launched: 2022-12-09_20:49:59.613319) 20:50:00.125453 run osmo-nitb_10.42.42.2(pid=13599): stderr: | (launched: 2022-12-09_20:49:59.660228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:50:00.267468 run osmo-nitb_10.42.42.2(pid=13599): stdout: | (launched: 2022-12-09_20:49:59.613319) 20:50:00.404106 run osmo-nitb_10.42.42.2(pid=13599): stderr: | (launched: 2022-12-09_20:49:59.660228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13599): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13599) [trial-2364↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13599)] 20:50:00.788525 tst osmo-nitb_10.42.42.2(pid=13599): stdout: | (launched: 2022-12-09_20:49:59.613319) 20:50:00.954312 tst osmo-nitb_10.42.42.2(pid=13599): stderr: | (launched: 2022-12-09_20:49:59.660228) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:50:01.107063 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13599): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13599) [trial-2364↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13599)] [trial-2364↪nitb_ussd:trx-lms↪assert_extension.py:12] 20:50:01.116570 tst assert_extension.py:12: Test FAILED (3.3 sec) 20:50:01.124168 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13598): Terminating (SIGTERM) 20:50:01.334996 --- ParallelTerminationStrategy: PID 13598 died... 20:50:01.357657 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13598): Terminated: ok {rc=0} 20:50:01.462955 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:trx-lms --------------------------------------------------------------------- 20:50:02.639580 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:02.643486 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 20:50:02.677164 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:50:02.703973 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 20:50:02.739449 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 20:50:02.773200 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:50:02.800144 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 20:50:03.324896 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:trx-lms assert_extension.py ---------------------------------------------- 20:50:03.330151 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.340558 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 20:50:03.387129 tst assert_extension.py: using LAC 23637 20:50:03.502258 tst assert_extension.py: using RAC 177 20:50:03.618908 tst assert_extension.py: using CellId 23637 20:50:03.733894 tst assert_extension.py: using BVCI 23638 20:50:03.841940 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.852386 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.862710 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.873271 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.883794 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 20:50:03.894038 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 20:50:04.009339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:04.469261 run create_hlr_db(pid=13606): Launched 20:50:04.581818 bus /sierra_2: Setting Powered False 20:50:05.640517 run create_hlr_db(pid=13606): Terminated: ok {rc=0} 20:50:06.073495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13608): Launched 20:50:06.388273 run osmo-hlr_10.42.42.2(pid=13609): Launched 20:50:06.508389 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:07.053629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13611): Launched 20:50:07.368197 run osmo-stp_10.42.42.5(pid=13612): Launched 20:50:07.487607 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:08.057709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13614): Launched 20:50:08.371597 run osmo-msc_10.42.42.6(pid=13615): Launched 20:50:08.547557 run osmo-stp_10.42.42.5(pid=13612): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13612)] 20:50:08.681415 run osmo-stp_10.42.42.5(pid=13612): stdout: | (launched: 2022-12-09_20:50:07.310255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:08.815262 run osmo-stp_10.42.42.5(pid=13612): stderr: | 20221209205007498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205007498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205007498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205007498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205007499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205007499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205007499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:08.947352 run osmo-stp_10.42.42.5(pid=13612): stdout: | (launched: 2022-12-09_20:50:07.310255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:09.072852 run osmo-stp_10.42.42.5(pid=13612): stderr: | 20221209205007498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205007498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205007498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205007498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205007499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205007499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205007499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:09.223269 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13612): Process ended prematurely: osmo-stp_10.42.42.5(pid=13612) [trial-2364↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13612)] [trial-2364↪ussd:trx-lms↪assert_extension.py:17] 20:50:09.232583 tst assert_extension.py:17: Test FAILED (5.9 sec) 20:50:09.260107 run osmo-hlr_10.42.42.2(pid=13609): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13609)] 20:50:09.310149 run osmo-hlr_10.42.42.2(pid=13609): stdout: | (launched: 2022-12-09_20:50:06.330329) 20:50:09.362668 run osmo-hlr_10.42.42.2(pid=13609): stderr: | 20221209205006526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205006526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205006526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205006526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205006526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205006527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205006538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205006547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205006547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205006547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:09.434663 run osmo-msc_10.42.42.6(pid=13615): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13615)] 20:50:09.484273 run osmo-msc_10.42.42.6(pid=13615): stdout: | (launched: 2022-12-09_20:50:08.314130) 20:50:09.535942 run osmo-msc_10.42.42.6(pid=13615): stderr: | 20221209205008630 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205008630 DLGLOBAL DEBUG validating counter group 0x7f598de55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205008630 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205008630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205008631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205008631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205008632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205008633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205008633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205008633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:09.588246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13608): Terminating (SIGTERM) 20:50:09.630154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13611): Terminating (SIGTERM) 20:50:09.671806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13614): Terminating (SIGTERM) 20:50:09.713836 --- ParallelTerminationStrategy: PID 13608 died... 20:50:09.733752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13608): Terminated: ok {rc=0} 20:50:09.780237 --- ParallelTerminationStrategy: PID 13611 died... 20:50:09.799885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13611): Terminated: ok {rc=0} 20:50:09.845985 --- ParallelTerminationStrategy: PID 13614 died... 20:50:09.865780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13614): Terminated: ok {rc=0} 20:50:09.953061 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:50:11.160765 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:11.167370 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:50:11.200563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:50:11.226944 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:50:11.278551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:50:11.312427 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:50:11.338780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:50:11.887539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:50:11.937093 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:11.947949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:50:12.017852 tst mo_mt_call.py: using LAC 23638 20:50:12.145495 tst mo_mt_call.py: using RAC 178 20:50:12.274537 tst mo_mt_call.py: using CellId 23638 20:50:12.402789 tst mo_mt_call.py: using BVCI 23639 20:50:12.513969 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:12.524935 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:12.535677 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:12.546454 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:12.557236 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:12.568141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:12.688015 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:12.809862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:13.305465 run create_hlr_db(pid=13620): Launched 20:50:13.435564 bus /sierra_2: Setting Powered False 20:50:14.498529 run create_hlr_db(pid=13620): Terminated: ok {rc=0} 20:50:14.926157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13622): Launched 20:50:15.225500 run osmo-hlr_10.42.42.2(pid=13623): Launched 20:50:15.340458 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:15.897269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13625): Launched 20:50:16.241736 run osmo-stp_10.42.42.5(pid=13626): Launched 20:50:16.521833 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:17.141361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13628): Launched 20:50:17.468857 run osmo-msc_10.42.42.6(pid=13629): Launched 20:50:17.647801 run osmo-stp_10.42.42.5(pid=13626): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13626)] 20:50:17.781914 run osmo-stp_10.42.42.5(pid=13626): stdout: | (launched: 2022-12-09_20:50:16.172320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:17.916410 run osmo-stp_10.42.42.5(pid=13626): stderr: | 20221209205016370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205016370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205016371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205016371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205016371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205016372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205016372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:18.050636 run osmo-stp_10.42.42.5(pid=13626): stdout: | (launched: 2022-12-09_20:50:16.172320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:18.178471 run osmo-stp_10.42.42.5(pid=13626): stderr: | 20221209205016370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205016370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205016371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205016371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205016371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205016372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205016372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:18.331439 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13626): Process ended prematurely: osmo-stp_10.42.42.5(pid=13626) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13626)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:50:18.341210 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 20:50:18.369179 run osmo-hlr_10.42.42.2(pid=13623): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13623)] 20:50:18.418752 run osmo-hlr_10.42.42.2(pid=13623): stdout: | (launched: 2022-12-09_20:50:15.170600) 20:50:18.470487 run osmo-hlr_10.42.42.2(pid=13623): stderr: | 20221209205015346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205015346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205015346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205015346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205015346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205015346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205015358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205015366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205015366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205015366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:18.541942 run osmo-msc_10.42.42.6(pid=13629): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13629)] 20:50:18.591820 run osmo-msc_10.42.42.6(pid=13629): stdout: | (launched: 2022-12-09_20:50:17.410599) 20:50:18.642962 run osmo-msc_10.42.42.6(pid=13629): stderr: | 20221209205017732 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205017732 DLGLOBAL DEBUG validating counter group 0x7fa11fe07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205017733 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205017733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205017733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205017733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205017735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205017735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205017735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205017735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:18.694912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13622): Terminating (SIGTERM) 20:50:18.736485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13625): Terminating (SIGTERM) 20:50:18.777965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13628): Terminating (SIGTERM) 20:50:18.819673 --- ParallelTerminationStrategy: PID 13622 died... 20:50:18.839463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13622): Terminated: ok {rc=0} 20:50:18.885619 --- ParallelTerminationStrategy: PID 13625 died... 20:50:18.905098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13625): Terminated: ok {rc=0} 20:50:18.951306 --- ParallelTerminationStrategy: PID 13628 died... 20:50:18.971136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13628): Terminated: ok {rc=0} 20:50:19.058849 bus /sierra_3: Setting Powered False 20:50:20.157140 bus /sierra_3: Setting Powered False 20:50:21.272128 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:50:22.419933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:22.432272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:50:22.507732 tst mo_mt_call_osmux.py: using LAC 23639 20:50:22.641050 tst mo_mt_call_osmux.py: using RAC 179 20:50:22.778633 tst mo_mt_call_osmux.py: using CellId 23639 20:50:22.900068 tst mo_mt_call_osmux.py: using BVCI 23640 20:50:23.010738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:23.021816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:23.032635 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:23.043731 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:23.054853 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:50:23.065947 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:23.186053 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:50:23.306669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:23.773622 run create_hlr_db(pid=13634): Launched 20:50:23.887868 bus /sierra_2: Setting Powered False 20:50:24.947258 run create_hlr_db(pid=13634): Terminated: ok {rc=0} 20:50:25.384462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13636): Launched 20:50:25.704505 run osmo-hlr_10.42.42.2(pid=13637): Launched 20:50:25.826402 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:26.378963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13639): Launched 20:50:26.700354 run osmo-stp_10.42.42.5(pid=13640): Launched 20:50:26.822857 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:27.402918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13642): Launched 20:50:27.723664 run osmo-msc_10.42.42.6(pid=13643): Launched 20:50:27.901105 run osmo-stp_10.42.42.5(pid=13640): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13640)] 20:50:28.035115 run osmo-stp_10.42.42.5(pid=13640): stdout: | (launched: 2022-12-09_20:50:26.642013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:28.169617 run osmo-stp_10.42.42.5(pid=13640): stderr: | 20221209205026831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205026831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205026831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205026831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205026832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205026832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205026832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:28.303497 run osmo-stp_10.42.42.5(pid=13640): stdout: | (launched: 2022-12-09_20:50:26.642013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:28.430991 run osmo-stp_10.42.42.5(pid=13640): stderr: | 20221209205026831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205026831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205026831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205026831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205026832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205026832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205026832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:28.584730 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13640): Process ended prematurely: osmo-stp_10.42.42.5(pid=13640) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13640)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:50:28.594378 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:50:28.621937 run osmo-hlr_10.42.42.2(pid=13637): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13637)] 20:50:28.671346 run osmo-hlr_10.42.42.2(pid=13637): stdout: | (launched: 2022-12-09_20:50:25.646245) 20:50:28.722258 run osmo-hlr_10.42.42.2(pid=13637): stderr: | 20221209205025842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205025842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205025842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205025842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205025842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205025842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205025855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205025863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205025863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205025863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:28.793379 run osmo-msc_10.42.42.6(pid=13643): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13643)] 20:50:28.842807 run osmo-msc_10.42.42.6(pid=13643): stdout: | (launched: 2022-12-09_20:50:27.664551) 20:50:28.893762 run osmo-msc_10.42.42.6(pid=13643): stderr: | 20221209205027984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205027984 DLGLOBAL DEBUG validating counter group 0x7ff063304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205027984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205027984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205027984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205027984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205027986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205027987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205027987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205027987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:28.945195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13636): Terminating (SIGTERM) 20:50:28.986045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13639): Terminating (SIGTERM) 20:50:29.027020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13642): Terminating (SIGTERM) 20:50:29.068189 --- ParallelTerminationStrategy: PID 13636 died... 20:50:29.087781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13636): Terminated: ok {rc=0} 20:50:29.133181 --- ParallelTerminationStrategy: PID 13639 died... 20:50:29.152238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13639): Terminated: ok {rc=0} 20:50:29.197378 --- ParallelTerminationStrategy: PID 13642 died... 20:50:29.216443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13642): Terminated: ok {rc=0} 20:50:29.302453 bus /sierra_3: Setting Powered False 20:50:30.398503 bus /sierra_3: Setting Powered False 20:50:31.517239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:50:32.774770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:32.781129 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:50:32.814126 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:50:32.840195 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:50:32.891770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:50:32.925171 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:50:32.952188 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:50:33.504761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:50:33.555760 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:33.567126 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:50:33.637345 tst mo_mt_call.py: using LAC 23640 20:50:33.762416 tst mo_mt_call.py: using RAC 180 20:50:33.888604 tst mo_mt_call.py: using CellId 23640 20:50:34.013972 tst mo_mt_call.py: using BVCI 23641 20:50:34.130108 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:34.141577 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:34.152712 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:34.163977 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:34.175278 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:34.186505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:34.300841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:34.419367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:34.916850 run create_hlr_db(pid=13648): Launched 20:50:35.046758 bus /sierra_2: Setting Powered False 20:50:36.110578 run create_hlr_db(pid=13648): Terminated: ok {rc=0} 20:50:36.539271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13650): Launched 20:50:36.840327 run osmo-hlr_10.42.42.2(pid=13651): Launched 20:50:36.955001 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:37.482658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13653): Launched 20:50:37.781705 run osmo-stp_10.42.42.5(pid=13654): Launched 20:50:37.895278 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:38.435533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13656): Launched 20:50:38.735560 run osmo-msc_10.42.42.6(pid=13657): Launched 20:50:38.902741 run osmo-stp_10.42.42.5(pid=13654): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13654)] 20:50:39.029645 run osmo-stp_10.42.42.5(pid=13654): stdout: | (launched: 2022-12-09_20:50:37.726910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:39.156464 run osmo-stp_10.42.42.5(pid=13654): stderr: | 20221209205037894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205037894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205037894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205037894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205037895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205037895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205037895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:39.281613 run osmo-stp_10.42.42.5(pid=13654): stdout: | (launched: 2022-12-09_20:50:37.726910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:39.401701 run osmo-stp_10.42.42.5(pid=13654): stderr: | 20221209205037894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205037894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205037894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205037894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205037895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205037895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205037895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:39.545184 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13654): Process ended prematurely: osmo-stp_10.42.42.5(pid=13654) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13654)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:50:39.554048 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:50:39.580811 run osmo-hlr_10.42.42.2(pid=13651): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13651)] 20:50:39.629203 run osmo-hlr_10.42.42.2(pid=13651): stdout: | (launched: 2022-12-09_20:50:36.785717) 20:50:39.678551 run osmo-hlr_10.42.42.2(pid=13651): stderr: | 20221209205036959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205036959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205036959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205036959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205036959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205036960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205036972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205036981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205036981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205036981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:39.747191 run osmo-msc_10.42.42.6(pid=13657): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13657)] 20:50:39.794940 run osmo-msc_10.42.42.6(pid=13657): stdout: | (launched: 2022-12-09_20:50:38.680392) 20:50:39.844355 run osmo-msc_10.42.42.6(pid=13657): stderr: | 20221209205038949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205038949 DLGLOBAL DEBUG validating counter group 0x7f1951662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205038949 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205038949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205038950 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205038950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205038952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205038953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205038953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205038953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:39.894144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13650): Terminating (SIGTERM) 20:50:39.933709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13653): Terminating (SIGTERM) 20:50:39.973283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13656): Terminating (SIGTERM) 20:50:40.013585 --- ParallelTerminationStrategy: PID 13650 died... 20:50:40.032078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13650): Terminated: ok {rc=0} 20:50:40.076660 --- ParallelTerminationStrategy: PID 13653 died... 20:50:40.094950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13653): Terminated: ok {rc=0} 20:50:40.139513 --- ParallelTerminationStrategy: PID 13656 died... 20:50:40.157922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13656): Terminated: ok {rc=0} 20:50:40.243370 bus /sierra_3: Setting Powered False 20:50:41.342725 bus /sierra_3: Setting Powered False 20:50:42.459087 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:50:43.604449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:43.616077 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:50:43.684681 tst mo_mt_call_osmux.py: using LAC 23641 20:50:43.803369 tst mo_mt_call_osmux.py: using RAC 181 20:50:43.922241 tst mo_mt_call_osmux.py: using CellId 23641 20:50:44.048564 tst mo_mt_call_osmux.py: using BVCI 23642 20:50:44.164672 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:44.176226 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:44.187614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:44.198902 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:44.210420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:50:44.221903 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:44.337214 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:50:44.456210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:44.955700 run create_hlr_db(pid=13659): Launched 20:50:45.085140 bus /sierra_2: Setting Powered False 20:50:46.146609 run create_hlr_db(pid=13659): Terminated: ok {rc=0} 20:50:46.631553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Launched 20:50:46.997732 run osmo-hlr_10.42.42.2(pid=13662): Launched 20:50:47.226754 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:47.751200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Launched 20:50:48.051285 run osmo-stp_10.42.42.5(pid=13665): Launched 20:50:48.166048 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:48.711246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13667): Launched 20:50:49.012418 run osmo-msc_10.42.42.6(pid=13668): Launched 20:50:49.181109 run osmo-stp_10.42.42.5(pid=13665): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] 20:50:49.308751 run osmo-stp_10.42.42.5(pid=13665): stdout: | (launched: 2022-12-09_20:50:47.996491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:49.436697 run osmo-stp_10.42.42.5(pid=13665): stderr: | 20221209205048162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205048162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205048163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205048163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205048164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205048164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205048164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:49.561982 run osmo-stp_10.42.42.5(pid=13665): stdout: | (launched: 2022-12-09_20:50:47.996491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:50:49.682031 run osmo-stp_10.42.42.5(pid=13665): stderr: | 20221209205048162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205048162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205048163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205048163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205048164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205048164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205048164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:50:49.825871 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13665): Process ended prematurely: osmo-stp_10.42.42.5(pid=13665) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:50:49.834714 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 20:50:49.861803 run osmo-hlr_10.42.42.2(pid=13662): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13662)] 20:50:49.909358 run osmo-hlr_10.42.42.2(pid=13662): stdout: | (launched: 2022-12-09_20:50:46.923044) 20:50:49.958982 run osmo-hlr_10.42.42.2(pid=13662): stderr: | 20221209205047141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205047141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205047141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205047141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205047141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205047141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205047159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205047176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205047176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205047176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:50:50.027984 run osmo-msc_10.42.42.6(pid=13668): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13668)] 20:50:50.075741 run osmo-msc_10.42.42.6(pid=13668): stdout: | (launched: 2022-12-09_20:50:48.957414) 20:50:50.125237 run osmo-msc_10.42.42.6(pid=13668): stderr: | 20221209205049224 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205049224 DLGLOBAL DEBUG validating counter group 0x7f5780595c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205049224 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205049224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205049224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205049225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205049226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205049227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205049227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205049227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:50:50.174831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Terminating (SIGTERM) 20:50:50.214390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Terminating (SIGTERM) 20:50:50.254142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13667): Terminating (SIGTERM) 20:50:50.294011 --- ParallelTerminationStrategy: PID 13661 died... 20:50:50.312814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Terminated: ok {rc=0} 20:50:50.357399 --- ParallelTerminationStrategy: PID 13664 died... 20:50:50.375663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Terminated: ok {rc=0} 20:50:50.420030 --- ParallelTerminationStrategy: PID 13667 died... 20:50:50.438434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13667): Terminated: ok {rc=0} 20:50:50.523955 bus /sierra_3: Setting Powered False 20:50:51.626241 bus /sierra_3: Setting Powered False 20:50:52.741744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:50:53.990227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:50:53.998379 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:50:54.032117 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:50:54.059276 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:50:54.111122 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:50:54.145192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:50:54.172211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:50:54.723198 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:50:54.774904 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:54.786365 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:50:54.856509 tst mo_mt_call.py: using LAC 23642 20:50:54.981398 tst mo_mt_call.py: using RAC 182 20:50:55.106672 tst mo_mt_call.py: using CellId 23642 20:50:55.233471 tst mo_mt_call.py: using BVCI 23643 20:50:55.349768 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:55.361200 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:55.372416 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:55.383761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:55.395089 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:50:55.406319 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:55.523380 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:50:55.646648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:50:56.143508 run create_hlr_db(pid=13673): Launched 20:50:56.272345 bus /sierra_2: Setting Powered False 20:50:57.332909 run create_hlr_db(pid=13673): Terminated: ok {rc=0} 20:50:57.778455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13675): Launched 20:50:58.097988 run osmo-hlr_10.42.42.2(pid=13676): Launched 20:50:58.219044 run osmo-stp_10.42.42.5: Starting osmo-stp 20:50:58.769162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13678): Launched 20:50:59.089313 run osmo-stp_10.42.42.5(pid=13679): Launched 20:50:59.211286 run osmo-msc_10.42.42.6: Starting osmo-msc 20:50:59.790779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13681): Launched 20:51:00.110950 run osmo-msc_10.42.42.6(pid=13682): Launched 20:51:00.288375 run osmo-stp_10.42.42.5(pid=13679): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13679)] 20:51:00.423428 run osmo-stp_10.42.42.5(pid=13679): stdout: | (launched: 2022-12-09_20:50:59.030274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:00.558325 run osmo-stp_10.42.42.5(pid=13679): stderr: | 20221209205059218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205059219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205059219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205059219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205059220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205059220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205059220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:00.692820 run osmo-stp_10.42.42.5(pid=13679): stdout: | (launched: 2022-12-09_20:50:59.030274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:00.821206 run osmo-stp_10.42.42.5(pid=13679): stderr: | 20221209205059218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205059219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205059219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205059219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205059220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205059220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205059220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:00.982104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13679): Process ended prematurely: osmo-stp_10.42.42.5(pid=13679) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13679)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:51:00.992220 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:51:01.020306 run osmo-hlr_10.42.42.2(pid=13676): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13676)] 20:51:01.070528 run osmo-hlr_10.42.42.2(pid=13676): stdout: | (launched: 2022-12-09_20:50:58.039938) 20:51:01.122791 run osmo-hlr_10.42.42.2(pid=13676): stderr: | 20221209205058236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205058236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205058236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205058236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205058236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205058236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205058249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205058257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205058257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205058257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:01.195307 run osmo-msc_10.42.42.6(pid=13682): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13682)] 20:51:01.245450 run osmo-msc_10.42.42.6(pid=13682): stdout: | (launched: 2022-12-09_20:51:00.052330) 20:51:01.297228 run osmo-msc_10.42.42.6(pid=13682): stderr: | 20221209205100371 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205100371 DLGLOBAL DEBUG validating counter group 0x7f5d4eb17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205100371 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205100371 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205100372 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205100372 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205100374 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205100374 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205100374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205100374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:01.349787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13675): Terminating (SIGTERM) 20:51:01.391602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13678): Terminating (SIGTERM) 20:51:01.433983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13681): Terminating (SIGTERM) 20:51:01.477351 --- ParallelTerminationStrategy: PID 13675 died... 20:51:01.497402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13675): Terminated: ok {rc=0} 20:51:01.543594 --- ParallelTerminationStrategy: PID 13678 died... 20:51:01.563322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13678): Terminated: ok {rc=0} 20:51:01.609943 --- ParallelTerminationStrategy: PID 13681 died... 20:51:01.629780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13681): Terminated: ok {rc=0} 20:51:01.717894 bus /sierra_3: Setting Powered False 20:51:02.816106 bus /sierra_3: Setting Powered False 20:51:03.932416 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:51:05.077661 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.089261 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:51:05.162387 tst mo_mt_call_osmux.py: using LAC 23643 20:51:05.279747 tst mo_mt_call_osmux.py: using RAC 183 20:51:05.395652 tst mo_mt_call_osmux.py: using CellId 23643 20:51:05.511396 tst mo_mt_call_osmux.py: using BVCI 23644 20:51:05.620257 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.631439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.642433 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.653575 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.664848 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:51:05.675959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:51:05.790549 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:51:05.909766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:06.406869 run create_hlr_db(pid=13684): Launched 20:51:06.536741 bus /sierra_2: Setting Powered False 20:51:07.600686 run create_hlr_db(pid=13684): Terminated: ok {rc=0} 20:51:08.029160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Launched 20:51:08.330237 run osmo-hlr_10.42.42.2(pid=13687): Launched 20:51:08.444238 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:08.973097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Launched 20:51:09.273292 run osmo-stp_10.42.42.5(pid=13690): Launched 20:51:09.388495 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:09.933665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13692): Launched 20:51:10.233827 run osmo-msc_10.42.42.6(pid=13693): Launched 20:51:10.400728 run osmo-stp_10.42.42.5(pid=13690): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] 20:51:10.528132 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-09_20:51:09.218388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:10.655205 run osmo-stp_10.42.42.5(pid=13690): stderr: | 20221209205109385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205109385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205109385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205109386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205109386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205109386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205109386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:10.780009 run osmo-stp_10.42.42.5(pid=13690): stdout: | (launched: 2022-12-09_20:51:09.218388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:10.899947 run osmo-stp_10.42.42.5(pid=13690): stderr: | 20221209205109385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205109385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205109385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205109386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205109386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205109386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205109386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:11.042984 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:51:11.051809 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:51:11.078389 run osmo-hlr_10.42.42.2(pid=13687): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13687)] 20:51:11.125760 run osmo-hlr_10.42.42.2(pid=13687): stdout: | (launched: 2022-12-09_20:51:08.275071) 20:51:11.174254 run osmo-hlr_10.42.42.2(pid=13687): stderr: | 20221209205108446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205108446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205108446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205108446 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205108446 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205108446 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205108456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205108465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205108465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205108465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:11.242276 run osmo-msc_10.42.42.6(pid=13693): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13693)] 20:51:11.289499 run osmo-msc_10.42.42.6(pid=13693): stdout: | (launched: 2022-12-09_20:51:10.178465) 20:51:11.338174 run osmo-msc_10.42.42.6(pid=13693): stderr: | 20221209205110447 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205110447 DLGLOBAL DEBUG validating counter group 0x7f7b7ac38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205110448 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205110448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205110448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205110448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205110450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205110450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205110450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205110450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:11.387183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminating (SIGTERM) 20:51:11.426189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminating (SIGTERM) 20:51:11.465244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13692): Terminating (SIGTERM) 20:51:11.504566 --- ParallelTerminationStrategy: PID 13686 died... 20:51:11.523411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13686): Terminated: ok {rc=0} 20:51:11.566829 --- ParallelTerminationStrategy: PID 13689 died... 20:51:11.585075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13689): Terminated: ok {rc=0} 20:51:11.628250 --- ParallelTerminationStrategy: PID 13692 died... 20:51:11.646339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13692): Terminated: ok {rc=0} 20:51:11.730216 bus /sierra_3: Setting Powered False 20:51:12.827266 bus /sierra_3: Setting Powered False 20:51:13.941620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:51:15.185661 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:15.192103 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:51:15.225587 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:51:15.251998 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:51:15.303364 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:51:15.335912 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:51:15.361908 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:51:15.939329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:51:16.016287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.030618 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:51:16.099437 tst mo_mt_call.py: using LAC 23644 20:51:16.219082 tst mo_mt_call.py: using RAC 184 20:51:16.388306 tst mo_mt_call.py: using CellId 23644 20:51:16.544612 tst mo_mt_call.py: using BVCI 23645 20:51:16.666435 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.679556 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.691768 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.705874 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.719034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:16.733000 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:16.852391 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:16.993100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:17.465160 run create_hlr_db(pid=13698): Launched 20:51:17.578794 bus /sierra_2: Setting Powered False 20:51:18.639134 run create_hlr_db(pid=13698): Terminated: ok {rc=0} 20:51:19.077538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13700): Launched 20:51:19.397749 run osmo-hlr_10.42.42.2(pid=13701): Launched 20:51:19.520012 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:20.071775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13703): Launched 20:51:20.391870 run osmo-stp_10.42.42.5(pid=13704): Launched 20:51:20.513520 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:21.094687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13706): Launched 20:51:21.414824 run osmo-msc_10.42.42.6(pid=13707): Launched 20:51:21.592810 run osmo-stp_10.42.42.5(pid=13704): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13704)] 20:51:21.727597 run osmo-stp_10.42.42.5(pid=13704): stdout: | (launched: 2022-12-09_20:51:20.333433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:21.862492 run osmo-stp_10.42.42.5(pid=13704): stderr: | 20221209205120522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205120522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205120522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205120523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205120523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205120523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205120523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:22.003429 run osmo-stp_10.42.42.5(pid=13704): stdout: | (launched: 2022-12-09_20:51:20.333433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:22.123213 run osmo-stp_10.42.42.5(pid=13704): stderr: | 20221209205120522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205120522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205120522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205120523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205120523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205120523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205120523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:22.266234 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13704): Process ended prematurely: osmo-stp_10.42.42.5(pid=13704) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13704)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:51:22.275378 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:51:22.302322 run osmo-hlr_10.42.42.2(pid=13701): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13701)] 20:51:22.350114 run osmo-hlr_10.42.42.2(pid=13701): stdout: | (launched: 2022-12-09_20:51:19.339446) 20:51:22.399510 run osmo-hlr_10.42.42.2(pid=13701): stderr: | 20221209205119535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205119535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205119535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205119535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205119535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205119535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205119548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205119556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205119556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205119556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:22.468442 run osmo-msc_10.42.42.6(pid=13707): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13707)] 20:51:22.516123 run osmo-msc_10.42.42.6(pid=13707): stdout: | (launched: 2022-12-09_20:51:21.356402) 20:51:22.565289 run osmo-msc_10.42.42.6(pid=13707): stderr: | 20221209205121674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205121674 DLGLOBAL DEBUG validating counter group 0x7fbd3a548c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205121674 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205121674 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205121675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205121675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205121677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205121677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205121677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205121677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:22.614952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13700): Terminating (SIGTERM) 20:51:22.654668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13703): Terminating (SIGTERM) 20:51:22.695235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13706): Terminating (SIGTERM) 20:51:22.735383 --- ParallelTerminationStrategy: PID 13700 died... 20:51:22.754445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13700): Terminated: ok {rc=0} 20:51:22.798998 --- ParallelTerminationStrategy: PID 13703 died... 20:51:22.817631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13703): Terminated: ok {rc=0} 20:51:22.861885 --- ParallelTerminationStrategy: PID 13706 died... 20:51:22.880450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13706): Terminated: ok {rc=0} 20:51:22.967352 bus /sierra_3: Setting Powered False 20:51:24.067276 bus /sierra_3: Setting Powered False 20:51:25.180697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:51:26.326989 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.338647 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:51:26.407567 tst mo_mt_call_osmux.py: using LAC 23645 20:51:26.525034 tst mo_mt_call_osmux.py: using RAC 185 20:51:26.642825 tst mo_mt_call_osmux.py: using CellId 23645 20:51:26.761373 tst mo_mt_call_osmux.py: using BVCI 23646 20:51:26.869778 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.880837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.891628 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.902761 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.913893 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:51:26.924912 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:27.043630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:51:27.159813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:27.659681 run create_hlr_db(pid=13709): Launched 20:51:27.791022 bus /sierra_2: Setting Powered False 20:51:28.854630 run create_hlr_db(pid=13709): Terminated: ok {rc=0} 20:51:29.284603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Launched 20:51:29.586504 run osmo-hlr_10.42.42.2(pid=13712): Launched 20:51:29.702546 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:30.234405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Launched 20:51:30.533384 run osmo-stp_10.42.42.5(pid=13715): Launched 20:51:30.647704 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:31.209435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13717): Launched 20:51:31.529993 run osmo-msc_10.42.42.6(pid=13718): Launched 20:51:31.868062 run osmo-stp_10.42.42.5(pid=13715): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] 20:51:32.198802 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-09_20:51:30.478483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:32.356492 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221209205130644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205130645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205130645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205130645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205130646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205130646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205130646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:32.490904 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-09_20:51:30.478483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:32.620007 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221209205130644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205130645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205130645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205130645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205130646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205130646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205130646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:32.774280 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:51:32.784017 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:51:32.811987 run osmo-hlr_10.42.42.2(pid=13712): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13712)] 20:51:32.862321 run osmo-hlr_10.42.42.2(pid=13712): stdout: | (launched: 2022-12-09_20:51:29.531282) 20:51:32.914187 run osmo-hlr_10.42.42.2(pid=13712): stderr: | 20221209205129704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205129704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205129704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205129704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205129704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205129704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205129716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205129726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205129726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205129726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:32.986369 run osmo-msc_10.42.42.6(pid=13718): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13718)] 20:51:33.036877 run osmo-msc_10.42.42.6(pid=13718): stdout: | (launched: 2022-12-09_20:51:31.471150) 20:51:33.088807 run osmo-msc_10.42.42.6(pid=13718): stderr: | 20221209205132053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205132054 DLGLOBAL DEBUG validating counter group 0x7f83b2d4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205132054 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205132054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205132054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205132054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205132056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205132056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205132056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205132056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:33.140865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminating (SIGTERM) 20:51:33.182574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminating (SIGTERM) 20:51:33.224653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13717): Terminating (SIGTERM) 20:51:33.267354 --- ParallelTerminationStrategy: PID 13711 died... 20:51:33.287377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminated: ok {rc=0} 20:51:33.333844 --- ParallelTerminationStrategy: PID 13714 died... 20:51:33.353536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminated: ok {rc=0} 20:51:33.399868 --- ParallelTerminationStrategy: PID 13717 died... 20:51:33.419536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13717): Terminated: ok {rc=0} 20:51:33.508499 bus /sierra_3: Setting Powered False 20:51:34.608124 bus /sierra_3: Setting Powered False 20:51:35.724647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:51:36.976932 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:36.983150 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:51:37.016098 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:51:37.042579 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:51:37.094837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:51:37.128663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:51:37.155695 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:51:37.701451 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:51:37.751010 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:37.762121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:51:37.831354 tst mo_mt_call.py: using LAC 23646 20:51:37.950305 tst mo_mt_call.py: using RAC 186 20:51:38.070226 tst mo_mt_call.py: using CellId 23646 20:51:38.188843 tst mo_mt_call.py: using BVCI 23647 20:51:38.296909 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:38.307850 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:38.318651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:38.329809 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:38.340752 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:38.351750 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:38.470600 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:38.592515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:39.092466 run create_hlr_db(pid=13724): Launched 20:51:39.223946 bus /sierra_2: Setting Powered False 20:51:40.288572 run create_hlr_db(pid=13724): Terminated: ok {rc=0} 20:51:40.720178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13726): Launched 20:51:41.021055 run osmo-hlr_10.42.42.2(pid=13727): Launched 20:51:41.135677 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:41.658185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13729): Launched 20:51:41.957691 run osmo-stp_10.42.42.5(pid=13730): Launched 20:51:42.071125 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:42.612059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13732): Launched 20:51:42.911782 run osmo-msc_10.42.42.6(pid=13733): Launched 20:51:43.079448 run osmo-stp_10.42.42.5(pid=13730): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13730)] 20:51:43.207322 run osmo-stp_10.42.42.5(pid=13730): stdout: | (launched: 2022-12-09_20:51:41.902794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:43.335287 run osmo-stp_10.42.42.5(pid=13730): stderr: | 20221209205142070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205142070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205142070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205142070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205142071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205142071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205142071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:43.460142 run osmo-stp_10.42.42.5(pid=13730): stdout: | (launched: 2022-12-09_20:51:41.902794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:43.580282 run osmo-stp_10.42.42.5(pid=13730): stderr: | 20221209205142070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205142070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205142070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205142070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205142071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205142071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205142071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:43.723430 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13730): Process ended prematurely: osmo-stp_10.42.42.5(pid=13730) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13730)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:51:43.732329 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:51:43.758635 run osmo-hlr_10.42.42.2(pid=13727): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13727)] 20:51:43.806081 run osmo-hlr_10.42.42.2(pid=13727): stdout: | (launched: 2022-12-09_20:51:40.965824) 20:51:43.855130 run osmo-hlr_10.42.42.2(pid=13727): stderr: | 20221209205141142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205141142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205141142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205141142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205141142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205141142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205141154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205141163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205141163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205141163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:43.923410 run osmo-msc_10.42.42.6(pid=13733): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13733)] 20:51:43.970716 run osmo-msc_10.42.42.6(pid=13733): stdout: | (launched: 2022-12-09_20:51:42.856562) 20:51:44.019489 run osmo-msc_10.42.42.6(pid=13733): stderr: | 20221209205143127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205143127 DLGLOBAL DEBUG validating counter group 0x7f6ba9a55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205143127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205143127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205143127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205143127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205143130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205143130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205143130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205143130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:44.069486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13726): Terminating (SIGTERM) 20:51:44.108751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13729): Terminating (SIGTERM) 20:51:44.147916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13732): Terminating (SIGTERM) 20:51:44.187102 --- ParallelTerminationStrategy: PID 13726 died... 20:51:44.205852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13726): Terminated: ok {rc=0} 20:51:44.249684 --- ParallelTerminationStrategy: PID 13729 died... 20:51:44.267815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13729): Terminated: ok {rc=0} 20:51:44.311526 --- ParallelTerminationStrategy: PID 13732 died... 20:51:44.329849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13732): Terminated: ok {rc=0} 20:51:44.412482 bus /sierra_3: Setting Powered False 20:51:45.509766 bus /sierra_3: Setting Powered False 20:51:46.636223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:51:47.780395 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:47.791926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:51:47.860600 tst mo_mt_call_osmux.py: using LAC 23647 20:51:47.979692 tst mo_mt_call_osmux.py: using RAC 187 20:51:48.098039 tst mo_mt_call_osmux.py: using CellId 23647 20:51:48.217817 tst mo_mt_call_osmux.py: using BVCI 23648 20:51:48.328490 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:48.339397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:48.350155 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:48.361214 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:48.372289 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:51:48.383275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:48.501481 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:51:48.618523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:51:49.083712 run create_hlr_db(pid=13735): Launched 20:51:49.197239 bus /sierra_2: Setting Powered False 20:51:50.256903 run create_hlr_db(pid=13735): Terminated: ok {rc=0} 20:51:50.696024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13737): Launched 20:51:51.016533 run osmo-hlr_10.42.42.2(pid=13738): Launched 20:51:51.138788 run osmo-stp_10.42.42.5: Starting osmo-stp 20:51:51.692233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Launched 20:51:52.012732 run osmo-stp_10.42.42.5(pid=13741): Launched 20:51:52.134718 run osmo-msc_10.42.42.6: Starting osmo-msc 20:51:52.714430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13743): Launched 20:51:53.033891 run osmo-msc_10.42.42.6(pid=13744): Launched 20:51:53.212681 run osmo-stp_10.42.42.5(pid=13741): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] 20:51:53.347794 run osmo-stp_10.42.42.5(pid=13741): stdout: | (launched: 2022-12-09_20:51:51.954304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:53.483116 run osmo-stp_10.42.42.5(pid=13741): stderr: | 20221209205152143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205152143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205152143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205152144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205152144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205152144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205152144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:53.617728 run osmo-stp_10.42.42.5(pid=13741): stdout: | (launched: 2022-12-09_20:51:51.954304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:51:53.745873 run osmo-stp_10.42.42.5(pid=13741): stderr: | 20221209205152143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205152143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205152143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205152144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205152144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205152144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205152144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:51:53.898660 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13741): Process ended prematurely: osmo-stp_10.42.42.5(pid=13741) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:51:53.908219 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 20:51:53.936158 run osmo-hlr_10.42.42.2(pid=13738): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13738)] 20:51:53.986002 run osmo-hlr_10.42.42.2(pid=13738): stdout: | (launched: 2022-12-09_20:51:50.958178) 20:51:54.037428 run osmo-hlr_10.42.42.2(pid=13738): stderr: | 20221209205151154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205151154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205151154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205151154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205151154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205151154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205151167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205151177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205151177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205151177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:51:54.109118 run osmo-msc_10.42.42.6(pid=13744): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13744)] 20:51:54.158577 run osmo-msc_10.42.42.6(pid=13744): stdout: | (launched: 2022-12-09_20:51:52.975644) 20:51:54.209574 run osmo-msc_10.42.42.6(pid=13744): stderr: | 20221209205153293 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205153293 DLGLOBAL DEBUG validating counter group 0x7f20159cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205153293 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205153293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205153293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205153294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205153295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205153296 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205153296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205153296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:51:54.261204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13737): Terminating (SIGTERM) 20:51:54.302260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Terminating (SIGTERM) 20:51:54.343604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13743): Terminating (SIGTERM) 20:51:54.384895 --- ParallelTerminationStrategy: PID 13737 died... 20:51:54.404621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13737): Terminated: ok {rc=0} 20:51:54.450134 --- ParallelTerminationStrategy: PID 13740 died... 20:51:54.469495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Terminated: ok {rc=0} 20:51:54.514740 --- ParallelTerminationStrategy: PID 13743 died... 20:51:54.534176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13743): Terminated: ok {rc=0} 20:51:54.620327 bus /sierra_3: Setting Powered False 20:51:55.720129 bus /sierra_3: Setting Powered False 20:51:56.834951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:51:58.083292 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:51:58.089987 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:51:58.122550 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:51:58.148724 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:51:58.201994 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:51:58.235315 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:51:58.261797 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:51:58.810028 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:51:58.858476 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:58.869643 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:51:58.938219 tst mo_mt_call.py: using LAC 23648 20:51:59.056148 tst mo_mt_call.py: using RAC 188 20:51:59.175911 tst mo_mt_call.py: using CellId 23648 20:51:59.296230 tst mo_mt_call.py: using BVCI 23649 20:51:59.410877 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:59.422030 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:59.432786 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:59.443913 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:59.455115 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:51:59.466237 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:59.585488 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:51:59.704504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:00.202743 run create_hlr_db(pid=13749): Launched 20:52:00.333337 bus /sierra_2: Setting Powered False 20:52:01.392480 run create_hlr_db(pid=13749): Terminated: ok {rc=0} 20:52:01.879083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Launched 20:52:02.221725 run osmo-hlr_10.42.42.2(pid=13752): Launched 20:52:02.342372 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:02.865878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Launched 20:52:03.165649 run osmo-stp_10.42.42.5(pid=13755): Launched 20:52:03.280620 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:03.825810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13757): Launched 20:52:04.126998 run osmo-msc_10.42.42.6(pid=13758): Launched 20:52:04.294784 run osmo-stp_10.42.42.5(pid=13755): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] 20:52:04.422131 run osmo-stp_10.42.42.5(pid=13755): stdout: | (launched: 2022-12-09_20:52:03.110590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:04.549682 run osmo-stp_10.42.42.5(pid=13755): stderr: | 20221209205203278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205203278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205203278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205203278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205203279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205203279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205203279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:04.674974 run osmo-stp_10.42.42.5(pid=13755): stdout: | (launched: 2022-12-09_20:52:03.110590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:04.794667 run osmo-stp_10.42.42.5(pid=13755): stderr: | 20221209205203278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205203278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205203278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205203278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205203279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205203279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205203279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:04.938098 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13755): Process ended prematurely: osmo-stp_10.42.42.5(pid=13755) [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:52:04.946939 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:52:04.973522 run osmo-hlr_10.42.42.2(pid=13752): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13752)] 20:52:05.021335 run osmo-hlr_10.42.42.2(pid=13752): stdout: | (launched: 2022-12-09_20:52:02.153966) 20:52:05.070495 run osmo-hlr_10.42.42.2(pid=13752): stderr: | 20221209205202344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205202344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205202344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205202344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205202344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205202344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205202355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205202364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205202364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205202364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:05.139021 run osmo-msc_10.42.42.6(pid=13758): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13758)] 20:52:05.186396 run osmo-msc_10.42.42.6(pid=13758): stdout: | (launched: 2022-12-09_20:52:04.070919) 20:52:05.235482 run osmo-msc_10.42.42.6(pid=13758): stderr: | 20221209205204338 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205204339 DLGLOBAL DEBUG validating counter group 0x7f65430f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205204339 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205204339 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205204339 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205204339 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205204341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205204342 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205204342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205204342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:05.284742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Terminating (SIGTERM) 20:52:05.324291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Terminating (SIGTERM) 20:52:05.363512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13757): Terminating (SIGTERM) 20:52:05.402775 --- ParallelTerminationStrategy: PID 13751 died... 20:52:05.421586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Terminated: ok {rc=0} 20:52:05.465289 --- ParallelTerminationStrategy: PID 13754 died... 20:52:05.483471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Terminated: ok {rc=0} 20:52:05.527391 --- ParallelTerminationStrategy: PID 13757 died... 20:52:05.545600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13757): Terminated: ok {rc=0} 20:52:05.628572 bus /sierra_3: Setting Powered False 20:52:06.722886 bus /sierra_3: Setting Powered False 20:52:07.837370 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:52:08.987998 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.000346 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:52:09.072742 tst mo_mt_call_osmux.py: using LAC 23649 20:52:09.200223 tst mo_mt_call_osmux.py: using RAC 189 20:52:09.318756 tst mo_mt_call_osmux.py: using CellId 23649 20:52:09.440176 tst mo_mt_call_osmux.py: using BVCI 23650 20:52:09.551322 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.562455 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.573436 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.584500 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.595741 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:52:09.607003 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:52:09.722467 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:52:09.836591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:10.304910 run create_hlr_db(pid=13760): Launched 20:52:10.419396 bus /sierra_2: Setting Powered False 20:52:11.479448 run create_hlr_db(pid=13760): Terminated: ok {rc=0} 20:52:11.900119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13762): Launched 20:52:12.203309 run osmo-hlr_10.42.42.2(pid=13763): Launched 20:52:12.318948 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:12.838050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13765): Launched 20:52:13.137697 run osmo-stp_10.42.42.5(pid=13766): Launched 20:52:13.251993 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:13.800452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13768): Launched 20:52:14.101506 run osmo-msc_10.42.42.6(pid=13769): Launched 20:52:14.269386 run osmo-stp_10.42.42.5(pid=13766): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13766)] 20:52:14.396920 run osmo-stp_10.42.42.5(pid=13766): stdout: | (launched: 2022-12-09_20:52:13.082586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:14.524714 run osmo-stp_10.42.42.5(pid=13766): stderr: | 20221209205213248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205213248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205213248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205213249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205213249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205213249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205213249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:14.650243 run osmo-stp_10.42.42.5(pid=13766): stdout: | (launched: 2022-12-09_20:52:13.082586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:14.770269 run osmo-stp_10.42.42.5(pid=13766): stderr: | 20221209205213248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205213248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205213248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205213249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205213249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205213249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205213249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:14.914346 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13766): Process ended prematurely: osmo-stp_10.42.42.5(pid=13766) [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13766)] [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 20:52:14.923160 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:52:14.950123 run osmo-hlr_10.42.42.2(pid=13763): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13763)] 20:52:14.997559 run osmo-hlr_10.42.42.2(pid=13763): stdout: | (launched: 2022-12-09_20:52:12.148018) 20:52:15.046377 run osmo-hlr_10.42.42.2(pid=13763): stderr: | 20221209205212319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205212320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205212320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205212320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205212320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205212320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205212360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205212370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205212370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205212371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:15.114799 run osmo-msc_10.42.42.6(pid=13769): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13769)] 20:52:15.161891 run osmo-msc_10.42.42.6(pid=13769): stdout: | (launched: 2022-12-09_20:52:14.046115) 20:52:15.210687 run osmo-msc_10.42.42.6(pid=13769): stderr: | 20221209205214315 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205214315 DLGLOBAL DEBUG validating counter group 0x7f5e2be05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205214315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205214315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205214316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205214316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205214318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205214318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205214318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205214318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:15.259671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13762): Terminating (SIGTERM) 20:52:15.299056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13765): Terminating (SIGTERM) 20:52:15.338500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13768): Terminating (SIGTERM) 20:52:15.378367 --- ParallelTerminationStrategy: PID 13762 died... 20:52:15.397327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13762): Terminated: ok {rc=0} 20:52:15.441462 --- ParallelTerminationStrategy: PID 13765 died... 20:52:15.459777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13765): Terminated: ok {rc=0} 20:52:15.503139 --- ParallelTerminationStrategy: PID 13768 died... 20:52:15.521388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13768): Terminated: ok {rc=0} 20:52:15.604760 bus /sierra_3: Setting Powered False 20:52:16.706594 bus /sierra_3: Setting Powered False 20:52:17.829951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:52:19.081410 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:19.087511 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:52:19.122719 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 20:52:19.149950 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 20:52:19.203813 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:52:19.236331 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 20:52:19.262373 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 20:52:19.813419 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 20:52:19.865393 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:19.876764 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:52:19.948334 tst mo_mt_call.py: using LAC 23650 20:52:20.076424 tst mo_mt_call.py: using RAC 190 20:52:20.195666 tst mo_mt_call.py: using CellId 23650 20:52:20.325152 tst mo_mt_call.py: using BVCI 23651 20:52:20.435052 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:20.445872 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:20.456387 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:20.467237 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:20.478540 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:20.489417 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:20.610396 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:20.729871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:21.229067 run create_hlr_db(pid=13774): Launched 20:52:21.360494 bus /sierra_2: Setting Powered False 20:52:22.424355 run create_hlr_db(pid=13774): Terminated: ok {rc=0} 20:52:22.854464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Launched 20:52:23.155096 run osmo-hlr_10.42.42.2(pid=13777): Launched 20:52:23.269274 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:23.800093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Launched 20:52:24.100557 run osmo-stp_10.42.42.5(pid=13780): Launched 20:52:24.214881 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:24.760781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13782): Launched 20:52:25.062417 run osmo-msc_10.42.42.6(pid=13783): Launched 20:52:25.230635 run osmo-stp_10.42.42.5(pid=13780): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] 20:52:25.358572 run osmo-stp_10.42.42.5(pid=13780): stdout: | (launched: 2022-12-09_20:52:24.045095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:25.486789 run osmo-stp_10.42.42.5(pid=13780): stderr: | 20221209205224214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205224214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205224214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205224215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205224215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205224215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205224215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:25.612093 run osmo-stp_10.42.42.5(pid=13780): stdout: | (launched: 2022-12-09_20:52:24.045095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:25.731997 run osmo-stp_10.42.42.5(pid=13780): stderr: | 20221209205224214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205224214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205224214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205224215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205224215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205224215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205224215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:25.875767 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13780): Process ended prematurely: osmo-stp_10.42.42.5(pid=13780) [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 20:52:25.884656 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:52:25.911536 run osmo-hlr_10.42.42.2(pid=13777): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13777)] 20:52:25.959122 run osmo-hlr_10.42.42.2(pid=13777): stdout: | (launched: 2022-12-09_20:52:23.100021) 20:52:26.008373 run osmo-hlr_10.42.42.2(pid=13777): stderr: | 20221209205223275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205223275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205223275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205223275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205223275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205223275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205223287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205223296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205223296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205223296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:26.077251 run osmo-msc_10.42.42.6(pid=13783): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13783)] 20:52:26.124829 run osmo-msc_10.42.42.6(pid=13783): stdout: | (launched: 2022-12-09_20:52:25.007033) 20:52:26.174091 run osmo-msc_10.42.42.6(pid=13783): stderr: | 20221209205225274 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205225274 DLGLOBAL DEBUG validating counter group 0x7fb8b271fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205225274 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205225275 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205225275 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205225275 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205225277 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205225277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205225277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205225277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:26.223710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Terminating (SIGTERM) 20:52:26.263158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Terminating (SIGTERM) 20:52:26.302750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13782): Terminating (SIGTERM) 20:52:26.342253 --- ParallelTerminationStrategy: PID 13776 died... 20:52:26.361477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13776): Terminated: ok {rc=0} 20:52:26.405573 --- ParallelTerminationStrategy: PID 13779 died... 20:52:26.424008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13779): Terminated: ok {rc=0} 20:52:26.467911 --- ParallelTerminationStrategy: PID 13782 died... 20:52:26.486351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13782): Terminated: ok {rc=0} 20:52:26.569536 bus /sierra_3: Setting Powered False 20:52:27.664627 bus /sierra_3: Setting Powered False 20:52:28.779432 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 20:52:29.928838 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:29.941060 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:52:30.014939 tst mo_mt_call_osmux.py: using LAC 23651 20:52:30.134255 tst mo_mt_call_osmux.py: using RAC 191 20:52:30.252363 tst mo_mt_call_osmux.py: using CellId 23651 20:52:30.371924 tst mo_mt_call_osmux.py: using BVCI 23652 20:52:30.481849 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:30.492585 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:30.503322 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:30.514233 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:30.525063 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 20:52:30.536319 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:30.654848 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 20:52:30.774269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:31.295567 run create_hlr_db(pid=13785): Launched 20:52:31.441746 bus /sierra_2: Setting Powered False 20:52:32.502495 run create_hlr_db(pid=13785): Terminated: ok {rc=0} 20:52:32.922762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13787): Launched 20:52:33.222566 run osmo-hlr_10.42.42.2(pid=13788): Launched 20:52:33.336209 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:33.864166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13790): Launched 20:52:34.163647 run osmo-stp_10.42.42.5(pid=13791): Launched 20:52:34.278272 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:34.821791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13793): Launched 20:52:35.122329 run osmo-msc_10.42.42.6(pid=13794): Launched 20:52:35.289598 run osmo-stp_10.42.42.5(pid=13791): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13791)] 20:52:35.415817 run osmo-stp_10.42.42.5(pid=13791): stdout: | (launched: 2022-12-09_20:52:34.108436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:35.543382 run osmo-stp_10.42.42.5(pid=13791): stderr: | 20221209205234274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205234274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205234275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205234275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205234276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205234276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205234276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:35.668345 run osmo-stp_10.42.42.5(pid=13791): stdout: | (launched: 2022-12-09_20:52:34.108436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:35.788008 run osmo-stp_10.42.42.5(pid=13791): stderr: | 20221209205234274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205234274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205234275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205234275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205234276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205234276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205234276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:35.932826 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13791): Process ended prematurely: osmo-stp_10.42.42.5(pid=13791) [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13791)] [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 20:52:35.941841 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:52:35.968605 run osmo-hlr_10.42.42.2(pid=13788): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13788)] 20:52:36.015953 run osmo-hlr_10.42.42.2(pid=13788): stdout: | (launched: 2022-12-09_20:52:33.167604) 20:52:36.064931 run osmo-hlr_10.42.42.2(pid=13788): stderr: | 20221209205233344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205233344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205233344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205233344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205233344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205233344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205233356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205233366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205233367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205233367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:36.133657 run osmo-msc_10.42.42.6(pid=13794): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13794)] 20:52:36.181221 run osmo-msc_10.42.42.6(pid=13794): stdout: | (launched: 2022-12-09_20:52:35.067004) 20:52:36.230212 run osmo-msc_10.42.42.6(pid=13794): stderr: | 20221209205235338 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205235338 DLGLOBAL DEBUG validating counter group 0x7fb021dc3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205235338 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205235338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205235338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205235338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205235341 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205235341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205235341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205235341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:36.279612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13787): Terminating (SIGTERM) 20:52:36.319039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13790): Terminating (SIGTERM) 20:52:36.358396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13793): Terminating (SIGTERM) 20:52:36.398034 --- ParallelTerminationStrategy: PID 13787 died... 20:52:36.416790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13787): Terminated: ok {rc=0} 20:52:36.461288 --- ParallelTerminationStrategy: PID 13790 died... 20:52:36.479583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13790): Terminated: ok {rc=0} 20:52:36.523561 --- ParallelTerminationStrategy: PID 13793 died... 20:52:36.542051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13793): Terminated: ok {rc=0} 20:52:36.627749 bus /sierra_3: Setting Powered False 20:52:37.729076 bus /sierra_3: Setting Powered False 20:52:38.843543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:trx-lms --------------------------------------------------------------------- 20:52:40.089685 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:52:40.093861 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 20:52:40.127958 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 20:52:40.154882 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 20:52:40.238983 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 20:52:40.272060 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 20:52:40.298833 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 20:52:40.880727 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 20:52:40.885701 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:40.896236 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 20:52:40.946504 tst emergency_mo_mt_call.py: using LAC 23652 20:52:41.065405 tst emergency_mo_mt_call.py: using RAC 192 20:52:41.190263 tst emergency_mo_mt_call.py: using CellId 23652 20:52:41.318039 tst emergency_mo_mt_call.py: using BVCI 23653 20:52:41.433725 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:41.444901 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:41.455876 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:41.466884 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:41.477902 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:41.488819 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:41.604073 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:41.719370 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:42.178942 run create_hlr_db(pid=13803): Launched 20:52:42.292616 bus /sierra_2: Setting Powered False 20:52:43.352049 run create_hlr_db(pid=13803): Terminated: ok {rc=0} 20:52:43.784590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Launched 20:52:44.099518 run osmo-hlr_10.42.42.2(pid=13806): Launched 20:52:44.220224 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:44.764786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Launched 20:52:45.079897 run osmo-stp_10.42.42.5(pid=13809): Launched 20:52:45.212554 tst emergency_mo_mt_call.py: using MSISDN 7372 20:52:45.375455 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:45.979290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Launched 20:52:46.325699 run osmo-msc_10.42.42.6(pid=13812): Launched 20:52:46.687140 run osmo-stp_10.42.42.5(pid=13809): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] 20:52:46.951217 run osmo-stp_10.42.42.5(pid=13809): stdout: | (launched: 2022-12-09_20:52:45.022381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:47.079552 run osmo-stp_10.42.42.5(pid=13809): stderr: | 20221209205245209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205245209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205245209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205245210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205245210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205245211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205245211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:47.208550 run osmo-stp_10.42.42.5(pid=13809): stdout: | (launched: 2022-12-09_20:52:45.022381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:47.330377 run osmo-stp_10.42.42.5(pid=13809): stderr: | 20221209205245209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205245209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205245209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205245210 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205245210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205245211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205245211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:47.473056 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13809): Process ended prematurely: osmo-stp_10.42.42.5(pid=13809) [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 20:52:47.481844 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 20:52:47.509439 run osmo-hlr_10.42.42.2(pid=13806): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13806)] 20:52:47.558008 run osmo-hlr_10.42.42.2(pid=13806): stdout: | (launched: 2022-12-09_20:52:44.042096) 20:52:47.608127 run osmo-hlr_10.42.42.2(pid=13806): stderr: | 20221209205244236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205244237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205244237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205244237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205244237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205244237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205244249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205244257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205244257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205244257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:47.678274 run osmo-msc_10.42.42.6(pid=13812): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13812)] 20:52:47.726635 run osmo-msc_10.42.42.6(pid=13812): stdout: | (launched: 2022-12-09_20:52:46.256804) 20:52:47.776486 run osmo-msc_10.42.42.6(pid=13812): stderr: | 20221209205246694 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205246695 DLGLOBAL DEBUG validating counter group 0x7f72403b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205246695 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205246695 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205246695 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205246696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205246698 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205246699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205246699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205246699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:47.826552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Terminating (SIGTERM) 20:52:47.866590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Terminating (SIGTERM) 20:52:47.906845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Terminating (SIGTERM) 20:52:47.947476 --- ParallelTerminationStrategy: PID 13805 died... 20:52:47.966456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13805): Terminated: ok {rc=0} 20:52:48.011644 --- ParallelTerminationStrategy: PID 13808 died... 20:52:48.030260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13808): Terminated: ok {rc=0} 20:52:48.075270 --- ParallelTerminationStrategy: PID 13811 died... 20:52:48.093877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13811): Terminated: ok {rc=0} 20:52:48.180254 bus /sierra_3: Setting Powered False 20:52:49.278257 bus /sierra_3: Setting Powered False 20:52:50.394820 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 20:52:51.481208 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:51.492531 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 20:52:51.543379 tst emergency_preemptive_call.py: using LAC 23653 20:52:51.661361 tst emergency_preemptive_call.py: using RAC 193 20:52:51.777209 tst emergency_preemptive_call.py: using CellId 23653 20:52:51.895384 tst emergency_preemptive_call.py: using BVCI 23654 20:52:52.011410 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:52.022816 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:52.033793 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:52.044912 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:52.056108 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 20:52:52.067280 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:52.188199 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:52.303460 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:52.421296 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 20:52:52.536160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:52:52.995475 run create_hlr_db(pid=13814): Launched 20:52:53.108101 bus /sierra_2: Setting Powered False 20:52:54.167847 run create_hlr_db(pid=13814): Terminated: ok {rc=0} 20:52:54.599839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Launched 20:52:54.916310 run osmo-hlr_10.42.42.2(pid=13817): Launched 20:52:55.036563 run osmo-stp_10.42.42.5: Starting osmo-stp 20:52:55.585280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Launched 20:52:55.901437 run osmo-stp_10.42.42.5(pid=13820): Launched 20:52:56.034690 tst emergency_preemptive_call.py: using MSISDN 7373 20:52:56.196233 run osmo-msc_10.42.42.6: Starting osmo-msc 20:52:56.763440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13822): Launched 20:52:57.079313 run osmo-msc_10.42.42.6(pid=13823): Launched 20:52:57.255053 run osmo-stp_10.42.42.5(pid=13820): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] 20:52:57.387955 run osmo-stp_10.42.42.5(pid=13820): stdout: | (launched: 2022-12-09_20:52:55.843507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:57.523024 run osmo-stp_10.42.42.5(pid=13820): stderr: | 20221209205256033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205256033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205256033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205256034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205256034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205256034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205256035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:57.655647 run osmo-stp_10.42.42.5(pid=13820): stdout: | (launched: 2022-12-09_20:52:55.843507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:52:57.783091 run osmo-stp_10.42.42.5(pid=13820): stderr: | 20221209205256033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205256033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205256033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205256034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205256034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205256034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205256035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:52:57.933560 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13820): Process ended prematurely: osmo-stp_10.42.42.5(pid=13820) [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py:32] 20:52:57.942595 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 20:52:57.970099 run osmo-hlr_10.42.42.2(pid=13817): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13817)] 20:52:58.019866 run osmo-hlr_10.42.42.2(pid=13817): stdout: | (launched: 2022-12-09_20:52:54.858464) 20:52:58.071248 run osmo-hlr_10.42.42.2(pid=13817): stderr: | 20221209205255056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205255056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205255056 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205255056 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205255056 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205255056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205255069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205255077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205255077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205255077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:52:58.143194 run osmo-msc_10.42.42.6(pid=13823): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13823)] 20:52:58.193300 run osmo-msc_10.42.42.6(pid=13823): stdout: | (launched: 2022-12-09_20:52:57.021287) 20:52:58.244590 run osmo-msc_10.42.42.6(pid=13823): stderr: | 20221209205257339 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205257340 DLGLOBAL DEBUG validating counter group 0x7f7a64e53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205257340 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205257340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205257340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205257340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205257342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205257342 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205257343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205257343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:52:58.296429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Terminating (SIGTERM) 20:52:58.338070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Terminating (SIGTERM) 20:52:58.379683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13822): Terminating (SIGTERM) 20:52:58.421579 --- ParallelTerminationStrategy: PID 13816 died... 20:52:58.441528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Terminated: ok {rc=0} 20:52:58.487520 --- ParallelTerminationStrategy: PID 13819 died... 20:52:58.507108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Terminated: ok {rc=0} 20:52:58.553269 --- ParallelTerminationStrategy: PID 13822 died... 20:52:58.572665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13822): Terminated: ok {rc=0} 20:52:58.660116 bus /sierra_9: Setting Powered False 20:52:59.758937 bus /sierra_9: Setting Powered False 20:53:00.876387 bus /sierra_8: Setting Powered False 20:53:01.997661 bus /sierra_8: Setting Powered False 20:53:03.129835 bus /sierra_3: Setting Powered False 20:53:04.229093 bus /sierra_3: Setting Powered False 20:53:05.347394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms --------------------------------------------------------------------- 20:53:06.623844 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:53:06.628844 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 20:53:06.666308 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 20:53:06.708367 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 20:53:06.797726 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 20:53:06.832703 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 20:53:06.873699 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 20:53:07.457229 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 20:53:07.510513 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:07.522173 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:07.573407 tst cs_paging_gprs_active.py: using LAC 23654 20:53:07.707039 tst cs_paging_gprs_active.py: using RAC 194 20:53:07.855380 tst cs_paging_gprs_active.py: using CellId 23654 20:53:07.988741 tst cs_paging_gprs_active.py: using BVCI 23655 20:53:08.151443 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.168505 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.185531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.207964 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.221828 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.237971 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.254314 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.269884 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:08.283714 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:08.420757 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:08.579457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:53:08.851059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:09.233092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13962): Launched 20:53:09.599513 run iperf3-srv_10.42.42.10(pid=14012): Launched 20:53:09.766740 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:53:10.026459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:10.414270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14101): Launched 20:53:10.749829 run iperf3-srv_10.42.42.10(pid=14103): Launched 20:53:10.875320 tst cs_paging_gprs_active.py:38: start network... 20:53:11.087461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:11.581448 run create_hlr_db(pid=14104): Launched 20:53:11.745625 bus /sierra_2: Setting Powered False 20:53:12.809491 run create_hlr_db(pid=14104): Terminated: ok {rc=0} 20:53:13.247265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14106): Launched 20:53:13.576573 run osmo-hlr_10.42.42.2(pid=14107): Launched 20:53:13.823934 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:14.541750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14109): Launched 20:53:14.871717 run osmo-stp_10.42.42.5(pid=14110): Launched 20:53:15.114992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:15.800168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14112): Launched 20:53:15.975287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:16.252419 run patchelf(pid=14113): Launched 20:53:16.514051 run osmo-stp_10.42.42.5(pid=14110): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14110)] 20:53:16.683168 run osmo-stp_10.42.42.5(pid=14110): stdout: | (launched: 2022-12-09_20:53:14.813426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:16.853976 run osmo-stp_10.42.42.5(pid=14110): stderr: | 20221209205315136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205315141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205315141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205315142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205315142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205315142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205315142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:17.022927 run osmo-stp_10.42.42.5(pid=14110): stdout: | (launched: 2022-12-09_20:53:14.813426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:17.180036 run osmo-stp_10.42.42.5(pid=14110): stderr: | 20221209205315136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205315141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205315141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205315142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205315142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205315142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205315142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:17.373046 run patchelf(pid=14113): Terminating (SIGINT) 20:53:17.593747 run patchelf(pid=14113): Terminated: ok {rc=0} 20:53:17.753474 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14110): Process ended prematurely: osmo-stp_10.42.42.5(pid=14110) [trial-2364↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14110)] [trial-2364↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 20:53:17.766808 tst cs_paging_gprs_active.py:38: Test FAILED (10.3 sec) 20:53:17.803436 run osmo-hlr_10.42.42.2(pid=14107): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14107)] 20:53:17.862018 run osmo-hlr_10.42.42.2(pid=14107): stdout: | (launched: 2022-12-09_20:53:13.517580) 20:53:17.926729 run osmo-hlr_10.42.42.2(pid=14107): stderr: | 20221209205313861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205313861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205313861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205313861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205313861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205313861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205313884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205313898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205313898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205313899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:17.987529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13962): Terminating (SIGTERM) 20:53:18.035563 run iperf3-srv_10.42.42.10(pid=14012): Terminating (SIGTERM) 20:53:18.085576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14101): Terminating (SIGTERM) 20:53:18.138249 run iperf3-srv_10.42.42.10(pid=14103): Terminating (SIGTERM) 20:53:18.192211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14106): Terminating (SIGTERM) 20:53:18.242961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14109): Terminating (SIGTERM) 20:53:18.292992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14112): Terminating (SIGTERM) 20:53:18.337312 --- ParallelTerminationStrategy: PID 13962 died... 20:53:18.357659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13962): Terminated: ok {rc=0} 20:53:18.405230 --- ParallelTerminationStrategy: PID 14012 died... 20:53:18.425218 run iperf3-srv_10.42.42.10(pid=14012): Terminated {rc=256} 20:53:18.471711 --- ParallelTerminationStrategy: PID 14101 died... 20:53:18.491802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14101): Terminated: ok {rc=0} 20:53:18.538485 --- ParallelTerminationStrategy: PID 14103 died... 20:53:18.558528 run iperf3-srv_10.42.42.10(pid=14103): Terminated {rc=256} 20:53:18.604884 --- ParallelTerminationStrategy: PID 14106 died... 20:53:18.625158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14106): Terminated: ok {rc=0} 20:53:18.671767 --- ParallelTerminationStrategy: PID 14109 died... 20:53:18.692114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14109): Terminated: ok {rc=0} 20:53:18.739052 --- ParallelTerminationStrategy: PID 14112 died... 20:53:18.759214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14112): Terminated: ok {rc=0} 20:53:18.848686 bus /gobi_0: Setting Powered False 20:53:19.954896 bus /gobi_0: Setting Powered False 20:53:21.074074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms iperf3.py ---------------------------------------------- 20:53:22.229572 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.241920 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:22.293963 tst iperf3.py: using LAC 23655 20:53:22.426494 tst iperf3.py: using RAC 195 20:53:22.557090 tst iperf3.py: using CellId 23655 20:53:22.686883 tst iperf3.py: using BVCI 23656 20:53:22.809832 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.821804 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.833690 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.845660 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.857520 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.869361 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.880681 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.892543 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:22.904767 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:23.027727 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:53:23.252934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:23.589633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Launched 20:53:23.889408 run iperf3-srv_10.42.42.10(pid=14115): Launched 20:53:24.028465 tst iperf3.py:8: start network... 20:53:24.253847 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:24.774581 run create_hlr_db(pid=14116): Launched 20:53:24.943243 bus /gobi_6: Setting Powered False 20:53:26.006817 run create_hlr_db(pid=14116): Terminated: ok {rc=0} 20:53:26.442636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Launched 20:53:26.747844 run osmo-hlr_10.42.42.2(pid=14119): Launched 20:53:26.864004 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:27.401531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Launched 20:53:27.707663 run osmo-stp_10.42.42.5(pid=14122): Launched 20:53:27.822775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:28.348189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Launched 20:53:28.464884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:28.721893 run patchelf(pid=14125): Launched 20:53:28.890280 run osmo-stp_10.42.42.5(pid=14122): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] 20:53:29.019095 run osmo-stp_10.42.42.5(pid=14122): stdout: | (launched: 2022-12-09_20:53:27.651547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:29.149674 run osmo-stp_10.42.42.5(pid=14122): stderr: | 20221209205327822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205327822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205327823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205327823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205327823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205327824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205327824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:29.280036 run osmo-stp_10.42.42.5(pid=14122): stdout: | (launched: 2022-12-09_20:53:27.651547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:29.404277 run osmo-stp_10.42.42.5(pid=14122): stderr: | 20221209205327822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205327822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205327823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205327823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205327823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205327824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205327824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:29.551641 run patchelf(pid=14125): Terminating (SIGINT) 20:53:29.722170 run patchelf(pid=14125): Terminated: ok {rc=0} 20:53:29.845500 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14122): Process ended prematurely: osmo-stp_10.42.42.5(pid=14122) [trial-2364↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] [trial-2364↪gprs:trx-lms↪iperf3.py:8] 20:53:29.854989 tst iperf3.py:8: Test FAILED (7.7 sec) 20:53:29.883213 run osmo-hlr_10.42.42.2(pid=14119): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14119)] 20:53:29.931052 run osmo-hlr_10.42.42.2(pid=14119): stdout: | (launched: 2022-12-09_20:53:26.691166) 20:53:29.981404 run osmo-hlr_10.42.42.2(pid=14119): stderr: | 20221209205326866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205326866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205326866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205326866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205326867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205326867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205326879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205326887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205326887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205326887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:30.031624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminating (SIGTERM) 20:53:30.071201 run iperf3-srv_10.42.42.10(pid=14115): Terminating (SIGTERM) 20:53:30.110643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Terminating (SIGTERM) 20:53:30.150330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Terminating (SIGTERM) 20:53:30.189959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Terminating (SIGTERM) 20:53:30.230077 --- ParallelTerminationStrategy: PID 14114 died... 20:53:30.248902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminated: ok {rc=0} 20:53:30.293297 --- ParallelTerminationStrategy: PID 14115 died... 20:53:30.311860 run iperf3-srv_10.42.42.10(pid=14115): Terminated {rc=256} 20:53:30.355185 --- ParallelTerminationStrategy: PID 14118 died... 20:53:30.374059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Terminated: ok {rc=0} 20:53:30.417931 --- ParallelTerminationStrategy: PID 14121 died... 20:53:30.436437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Terminated: ok {rc=0} 20:53:30.480328 --- ParallelTerminationStrategy: PID 14124 died... 20:53:30.498933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Terminated: ok {rc=0} 20:53:30.584623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms iperf3m4.py ---------------------------------------------- 20:53:31.735778 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:31.748101 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:31.797945 tst iperf3m4.py: using LAC 23656 20:53:31.921194 tst iperf3m4.py: using RAC 196 20:53:32.079822 tst iperf3m4.py: using CellId 23656 20:53:32.207769 tst iperf3m4.py: using BVCI 23657 20:53:32.327225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.338651 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.349726 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.360537 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.371628 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.382584 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.393651 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.404227 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:32.415214 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:32.531836 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:32.660115 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:32.781799 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:32.903221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:53:33.122398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:33.447344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Launched 20:53:33.730844 run iperf3-srv_10.42.42.10(pid=14127): Launched 20:53:33.852476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:53:34.071096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:34.396081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Launched 20:53:34.678265 run iperf3-srv_10.42.42.10(pid=14129): Launched 20:53:34.801414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:53:35.019967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:35.345756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14130): Launched 20:53:35.628675 run iperf3-srv_10.42.42.10(pid=14131): Launched 20:53:35.750937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:53:35.971578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:53:36.298441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Launched 20:53:36.580706 run iperf3-srv_10.42.42.10(pid=14133): Launched 20:53:36.702601 tst iperf3m4.py:8: start network... 20:53:36.922173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:37.430182 run create_hlr_db(pid=14134): Launched 20:53:37.561995 bus /gobi_6: Setting Powered False 20:53:38.626139 run create_hlr_db(pid=14134): Terminated: ok {rc=0} 20:53:39.061396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14136): Launched 20:53:39.365962 run osmo-hlr_10.42.42.2(pid=14137): Launched 20:53:39.482301 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:40.021664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14139): Launched 20:53:40.326419 run osmo-stp_10.42.42.5(pid=14140): Launched 20:53:40.442098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:40.965174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14142): Launched 20:53:41.081434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:41.338017 run patchelf(pid=14143): Launched 20:53:41.506077 run osmo-stp_10.42.42.5(pid=14140): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14140)] 20:53:41.634503 run osmo-stp_10.42.42.5(pid=14140): stdout: | (launched: 2022-12-09_20:53:40.270062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:41.764648 run osmo-stp_10.42.42.5(pid=14140): stderr: | 20221209205340439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205340439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205340439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205340440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205340440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205340440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205340440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:41.894633 run osmo-stp_10.42.42.5(pid=14140): stdout: | (launched: 2022-12-09_20:53:40.270062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:42.018964 run osmo-stp_10.42.42.5(pid=14140): stderr: | 20221209205340439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205340439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205340439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205340440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205340440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205340440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205340440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:42.166887 run patchelf(pid=14143): Terminating (SIGINT) 20:53:42.336905 run patchelf(pid=14143): Terminated: ok {rc=0} 20:53:42.459809 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14140): Process ended prematurely: osmo-stp_10.42.42.5(pid=14140) [trial-2364↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14140)] [trial-2364↪gprs:trx-lms↪iperf3m4.py:8] 20:53:42.469445 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:53:42.497250 run osmo-hlr_10.42.42.2(pid=14137): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14137)] 20:53:42.545477 run osmo-hlr_10.42.42.2(pid=14137): stdout: | (launched: 2022-12-09_20:53:39.309767) 20:53:42.595135 run osmo-hlr_10.42.42.2(pid=14137): stderr: | 20221209205339486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205339486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205339486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205339486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205339486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205339486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205339498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205339506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205339507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205339507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:42.645349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Terminating (SIGTERM) 20:53:42.685234 run iperf3-srv_10.42.42.10(pid=14127): Terminating (SIGTERM) 20:53:42.725666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Terminating (SIGTERM) 20:53:42.765444 run iperf3-srv_10.42.42.10(pid=14129): Terminating (SIGTERM) 20:53:42.805159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14130): Terminating (SIGTERM) 20:53:42.844930 run iperf3-srv_10.42.42.10(pid=14131): Terminating (SIGTERM) 20:53:42.884854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Terminating (SIGTERM) 20:53:42.924686 run iperf3-srv_10.42.42.10(pid=14133): Terminating (SIGTERM) 20:53:42.964330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14136): Terminating (SIGTERM) 20:53:43.004264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14139): Terminating (SIGTERM) 20:53:43.044184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14142): Terminating (SIGTERM) 20:53:43.084331 --- ParallelTerminationStrategy: PID 14126 died... 20:53:43.103428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14126): Terminated: ok {rc=0} 20:53:43.147767 --- ParallelTerminationStrategy: PID 14127 died... 20:53:43.166301 run iperf3-srv_10.42.42.10(pid=14127): Terminated {rc=256} 20:53:43.210242 --- ParallelTerminationStrategy: PID 14128 died... 20:53:43.228771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14128): Terminated: ok {rc=0} 20:53:43.272919 --- ParallelTerminationStrategy: PID 14129 died... 20:53:43.291799 run iperf3-srv_10.42.42.10(pid=14129): Terminated {rc=256} 20:53:43.335800 --- ParallelTerminationStrategy: PID 14130 died... 20:53:43.354838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14130): Terminated: ok {rc=0} 20:53:43.399044 --- ParallelTerminationStrategy: PID 14131 died... 20:53:43.417683 run iperf3-srv_10.42.42.10(pid=14131): Terminated {rc=256} 20:53:43.461698 --- ParallelTerminationStrategy: PID 14132 died... 20:53:43.480376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14132): Terminated: ok {rc=0} 20:53:43.524697 --- ParallelTerminationStrategy: PID 14133 died... 20:53:43.543363 run iperf3-srv_10.42.42.10(pid=14133): Terminated {rc=256} 20:53:43.587486 --- ParallelTerminationStrategy: PID 14136 died... 20:53:43.606132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14136): Terminated: ok {rc=0} 20:53:43.650351 --- ParallelTerminationStrategy: PID 14139 died... 20:53:43.669048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14139): Terminated: ok {rc=0} 20:53:43.713327 --- ParallelTerminationStrategy: PID 14142 died... 20:53:43.731945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14142): Terminated: ok {rc=0} 20:53:43.815831 bus /gobi_4: Setting Powered False 20:53:44.910704 bus /gobi_4: Setting Powered False 20:53:46.042500 bus /gobi_1: Setting Powered False 20:53:47.162539 bus /gobi_1: Setting Powered False 20:53:48.280573 bus /gobi_0: Setting Powered False 20:53:49.380649 bus /gobi_0: Setting Powered False 20:53:50.496942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms ping.py ---------------------------------------------- 20:53:51.598905 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:51.610296 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:51.662183 tst ping.py: using LAC 23657 20:53:51.778277 tst ping.py: using RAC 197 20:53:51.895670 tst ping.py: using CellId 23657 20:53:52.011610 tst ping.py: using BVCI 23658 20:53:52.129578 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.140913 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.152338 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.163453 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.174284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.185368 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.196425 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:52.207505 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:53:52.326874 tst ping.py:19: start network... 20:53:52.541281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:53:53.035598 run create_hlr_db(pid=14144): Launched 20:53:53.164137 bus /gobi_6: Setting Powered False 20:53:54.227925 run create_hlr_db(pid=14144): Terminated: ok {rc=0} 20:53:54.655133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14146): Launched 20:53:54.952678 run osmo-hlr_10.42.42.2(pid=14147): Launched 20:53:55.065156 run osmo-stp_10.42.42.5: Starting osmo-stp 20:53:55.594079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14149): Launched 20:53:55.894149 run osmo-stp_10.42.42.5(pid=14150): Launched 20:53:56.007703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:53:56.525322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14152): Launched 20:53:56.647811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:53:56.918400 run patchelf(pid=14153): Launched 20:53:57.097946 run osmo-stp_10.42.42.5(pid=14150): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14150)] 20:53:57.232853 run osmo-stp_10.42.42.5(pid=14150): stdout: | (launched: 2022-12-09_20:53:55.838813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:57.369778 run osmo-stp_10.42.42.5(pid=14150): stderr: | 20221209205356009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205356009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205356009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205356010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205356010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205356010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205356010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:57.506885 run osmo-stp_10.42.42.5(pid=14150): stdout: | (launched: 2022-12-09_20:53:55.838813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:53:57.637491 run osmo-stp_10.42.42.5(pid=14150): stderr: | 20221209205356009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205356009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205356009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205356010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205356010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205356010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205356010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:53:57.793188 run patchelf(pid=14153): Terminating (SIGINT) 20:53:57.971497 run patchelf(pid=14153): Terminated: ok {rc=0} 20:53:58.100016 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14150): Process ended prematurely: osmo-stp_10.42.42.5(pid=14150) [trial-2364↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14150)] [trial-2364↪gprs:trx-lms↪ping.py:22] 20:53:58.109706 tst ping.py:22: Test FAILED (6.5 sec) 20:53:58.138043 run osmo-hlr_10.42.42.2(pid=14147): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14147)] 20:53:58.188594 run osmo-hlr_10.42.42.2(pid=14147): stdout: | (launched: 2022-12-09_20:53:54.897682) 20:53:58.240811 run osmo-hlr_10.42.42.2(pid=14147): stderr: | 20221209205355075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205355075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205355075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205355075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205355075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205355075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205355087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205355097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205355097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205355097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:53:58.293491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14146): Terminating (SIGTERM) 20:53:58.336013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14149): Terminating (SIGTERM) 20:53:58.378234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14152): Terminating (SIGTERM) 20:53:58.420219 --- ParallelTerminationStrategy: PID 14146 died... 20:53:58.440453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14146): Terminated: ok {rc=0} 20:53:58.487311 --- ParallelTerminationStrategy: PID 14149 died... 20:53:58.507055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14149): Terminated: ok {rc=0} 20:53:58.553446 --- ParallelTerminationStrategy: PID 14152 died... 20:53:58.573210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14152): Terminated: ok {rc=0} 20:53:58.661238 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 20:53:59.750029 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:53:59.761671 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 20:53:59.812412 tst ping_idle_ping.py: using LAC 23658 20:53:59.945951 tst ping_idle_ping.py: using RAC 198 20:54:00.076488 tst ping_idle_ping.py: using CellId 23658 20:54:00.201752 tst ping_idle_ping.py: using BVCI 23659 20:54:00.312736 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.323447 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.334089 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.344878 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.355591 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.366067 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.377075 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 20:54:00.387783 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 20:54:00.505953 tst ping_idle_ping.py:24: start network... 20:54:00.722479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:01.250875 run create_hlr_db(pid=14154): Launched 20:54:01.410216 bus /gobi_6: Setting Powered False 20:54:02.469920 run create_hlr_db(pid=14154): Terminated: ok {rc=0} 20:54:02.912496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Launched 20:54:03.232912 run osmo-hlr_10.42.42.2(pid=14157): Launched 20:54:03.354735 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:03.908101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Launched 20:54:04.228719 run osmo-stp_10.42.42.5(pid=14160): Launched 20:54:04.354390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:04.909090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Launched 20:54:05.031065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:05.301366 run patchelf(pid=14163): Launched 20:54:05.479508 run osmo-stp_10.42.42.5(pid=14160): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] 20:54:05.614936 run osmo-stp_10.42.42.5(pid=14160): stdout: | (launched: 2022-12-09_20:54:04.169903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:05.752659 run osmo-stp_10.42.42.5(pid=14160): stderr: | 20221209205404363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205404364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205404364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205404364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205404365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205404365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205404365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:05.889551 run osmo-stp_10.42.42.5(pid=14160): stdout: | (launched: 2022-12-09_20:54:04.169903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:06.020751 run osmo-stp_10.42.42.5(pid=14160): stderr: | 20221209205404363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205404364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205404364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205404364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205404365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205404365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205404365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:06.176183 run patchelf(pid=14163): Terminating (SIGINT) 20:54:06.355792 run patchelf(pid=14163): Terminated: ok {rc=0} 20:54:06.484666 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14160): Process ended prematurely: osmo-stp_10.42.42.5(pid=14160) [trial-2364↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] [trial-2364↪gprs:trx-lms↪ping_idle_ping.py:27] 20:54:06.494455 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 20:54:06.522709 run osmo-hlr_10.42.42.2(pid=14157): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14157)] 20:54:06.572484 run osmo-hlr_10.42.42.2(pid=14157): stdout: | (launched: 2022-12-09_20:54:03.174140) 20:54:06.624078 run osmo-hlr_10.42.42.2(pid=14157): stderr: | 20221209205403375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205403376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205403376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205403376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205403376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205403376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205403389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205403398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205403398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205403398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:06.676801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Terminating (SIGTERM) 20:54:06.719056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Terminating (SIGTERM) 20:54:06.761086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Terminating (SIGTERM) 20:54:06.803244 --- ParallelTerminationStrategy: PID 14156 died... 20:54:06.823352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Terminated: ok {rc=0} 20:54:06.869744 --- ParallelTerminationStrategy: PID 14159 died... 20:54:06.889389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Terminated: ok {rc=0} 20:54:06.935130 --- ParallelTerminationStrategy: PID 14162 died... 20:54:06.954866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Terminated: ok {rc=0} 20:54:07.042522 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 20:54:08.346838 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:54:08.352577 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 20:54:08.386503 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 20:54:08.425838 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 20:54:08.514366 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 20:54:08.548003 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 20:54:08.587252 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 20:54:09.181622 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 20:54:09.234231 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.245476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:09.297016 tst cs_paging_gprs_active.py: using LAC 23659 20:54:09.426323 tst cs_paging_gprs_active.py: using RAC 199 20:54:09.555720 tst cs_paging_gprs_active.py: using CellId 23659 20:54:09.684925 tst cs_paging_gprs_active.py: using BVCI 23660 20:54:09.803816 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.815211 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.826250 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.837308 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.848244 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.859219 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.870475 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.881447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:09.892556 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:10.008836 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:10.127834 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:54:10.334391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:10.642112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Launched 20:54:10.910919 run iperf3-srv_10.42.42.10(pid=14169): Launched 20:54:11.025790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:54:11.230547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:11.537469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Launched 20:54:11.803667 run iperf3-srv_10.42.42.10(pid=14171): Launched 20:54:11.927018 tst cs_paging_gprs_active.py:38: start network... 20:54:12.147697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:12.654209 run create_hlr_db(pid=14172): Launched 20:54:12.788229 bus /gobi_6: Setting Powered False 20:54:13.851763 run create_hlr_db(pid=14172): Terminated: ok {rc=0} 20:54:14.302923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14174): Launched 20:54:14.630467 run osmo-hlr_10.42.42.2(pid=14175): Launched 20:54:14.755259 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:15.318528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14177): Launched 20:54:15.644575 run osmo-stp_10.42.42.5(pid=14178): Launched 20:54:15.768759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:16.454031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14180): Launched 20:54:16.586527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:16.853142 run patchelf(pid=14181): Launched 20:54:17.042382 run osmo-stp_10.42.42.5(pid=14178): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14178)] 20:54:17.178146 run osmo-stp_10.42.42.5(pid=14178): stdout: | (launched: 2022-12-09_20:54:15.584827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:17.311295 run osmo-stp_10.42.42.5(pid=14178): stderr: | 20221209205415779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205415779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205415779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205415780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205415780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205415780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205415781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:17.443602 run osmo-stp_10.42.42.5(pid=14178): stdout: | (launched: 2022-12-09_20:54:15.584827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:17.568692 run osmo-stp_10.42.42.5(pid=14178): stderr: | 20221209205415779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205415779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205415779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205415780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205415780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205415780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205415781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:17.717083 run patchelf(pid=14181): Terminating (SIGINT) 20:54:17.889089 run patchelf(pid=14181): Terminated: ok {rc=0} 20:54:18.013163 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14178): Process ended prematurely: osmo-stp_10.42.42.5(pid=14178) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14178)] [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 20:54:18.023003 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 20:54:18.051941 run osmo-hlr_10.42.42.2(pid=14175): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14175)] 20:54:18.100079 run osmo-hlr_10.42.42.2(pid=14175): stdout: | (launched: 2022-12-09_20:54:14.570883) 20:54:18.149926 run osmo-hlr_10.42.42.2(pid=14175): stderr: | 20221209205414771 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205414771 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205414772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205414772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205414772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205414772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205414783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205414792 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205414792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205414792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:18.200171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Terminating (SIGTERM) 20:54:18.240323 run iperf3-srv_10.42.42.10(pid=14169): Terminating (SIGTERM) 20:54:18.280564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Terminating (SIGTERM) 20:54:18.320998 run iperf3-srv_10.42.42.10(pid=14171): Terminating (SIGTERM) 20:54:18.361427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14174): Terminating (SIGTERM) 20:54:18.401996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14177): Terminating (SIGTERM) 20:54:18.442532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14180): Terminating (SIGTERM) 20:54:18.483192 --- ParallelTerminationStrategy: PID 14168 died... 20:54:18.502267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14168): Terminated: ok {rc=0} 20:54:18.547735 --- ParallelTerminationStrategy: PID 14169 died... 20:54:18.566320 run iperf3-srv_10.42.42.10(pid=14169): Terminated {rc=256} 20:54:18.611249 --- ParallelTerminationStrategy: PID 14170 died... 20:54:18.629927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14170): Terminated: ok {rc=0} 20:54:18.675023 --- ParallelTerminationStrategy: PID 14171 died... 20:54:18.693583 run iperf3-srv_10.42.42.10(pid=14171): Terminated {rc=256} 20:54:18.738753 --- ParallelTerminationStrategy: PID 14174 died... 20:54:18.757331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14174): Terminated: ok {rc=0} 20:54:18.802406 --- ParallelTerminationStrategy: PID 14177 died... 20:54:18.821207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14177): Terminated: ok {rc=0} 20:54:18.866430 --- ParallelTerminationStrategy: PID 14180 died... 20:54:18.885132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14180): Terminated: ok {rc=0} 20:54:18.972803 bus /gobi_0: Setting Powered False 20:54:20.072919 bus /gobi_0: Setting Powered False 20:54:21.187269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 20:54:22.336568 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.348514 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:22.405385 tst iperf3.py: using LAC 23660 20:54:22.532487 tst iperf3.py: using RAC 200 20:54:22.658731 tst iperf3.py: using CellId 23660 20:54:22.786816 tst iperf3.py: using BVCI 23661 20:54:22.905184 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.916436 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.927517 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.938590 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.949674 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.960582 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.971817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.982805 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:22.993979 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:23.109266 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:54:23.314492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:23.621156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Launched 20:54:23.886358 run iperf3-srv_10.42.42.10(pid=14183): Launched 20:54:24.000142 tst iperf3.py:8: start network... 20:54:24.204453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:24.675818 run create_hlr_db(pid=14184): Launched 20:54:24.791751 bus /gobi_6: Setting Powered False 20:54:25.851992 run create_hlr_db(pid=14184): Terminated: ok {rc=0} 20:54:26.297230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Launched 20:54:26.625098 run osmo-hlr_10.42.42.2(pid=14188): Launched 20:54:26.753285 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:27.314935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14190): Launched 20:54:27.642029 run osmo-stp_10.42.42.5(pid=14191): Launched 20:54:27.767572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:28.329570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14193): Launched 20:54:28.455479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:28.730522 run patchelf(pid=14194): Launched 20:54:28.911753 run osmo-stp_10.42.42.5(pid=14191): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] 20:54:29.048591 run osmo-stp_10.42.42.5(pid=14191): stdout: | (launched: 2022-12-09_20:54:27.582581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:29.187119 run osmo-stp_10.42.42.5(pid=14191): stderr: | 20221209205427776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205427776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205427776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205427777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205427777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205427777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205427777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:29.325664 run osmo-stp_10.42.42.5(pid=14191): stdout: | (launched: 2022-12-09_20:54:27.582581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:29.459053 run osmo-stp_10.42.42.5(pid=14191): stderr: | 20221209205427776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205427776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205427776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205427777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205427777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205427777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205427777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:29.616234 run patchelf(pid=14194): Terminating (SIGINT) 20:54:29.798323 run patchelf(pid=14194): Terminated: ok {rc=0} 20:54:29.929109 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14191): Process ended prematurely: osmo-stp_10.42.42.5(pid=14191) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 20:54:29.939380 tst iperf3.py:8: Test FAILED (7.6 sec) 20:54:29.967950 run osmo-hlr_10.42.42.2(pid=14188): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14188)] 20:54:30.017523 run osmo-hlr_10.42.42.2(pid=14188): stdout: | (launched: 2022-12-09_20:54:26.565549) 20:54:30.068737 run osmo-hlr_10.42.42.2(pid=14188): stderr: | 20221209205426764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205426764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205426764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205426764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205426765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205426765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205426776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205426785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205426786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205426786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:30.120514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Terminating (SIGTERM) 20:54:30.161934 run iperf3-srv_10.42.42.10(pid=14183): Terminating (SIGTERM) 20:54:30.203486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminating (SIGTERM) 20:54:30.245259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14190): Terminating (SIGTERM) 20:54:30.286436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14193): Terminating (SIGTERM) 20:54:30.328373 --- ParallelTerminationStrategy: PID 14182 died... 20:54:30.348334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Terminated: ok {rc=0} 20:54:30.394664 --- ParallelTerminationStrategy: PID 14183 died... 20:54:30.414501 run iperf3-srv_10.42.42.10(pid=14183): Terminated {rc=256} 20:54:30.460838 --- ParallelTerminationStrategy: PID 14186 died... 20:54:30.480810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminated: ok {rc=0} 20:54:30.526455 --- ParallelTerminationStrategy: PID 14190 died... 20:54:30.546056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14190): Terminated: ok {rc=0} 20:54:30.591857 --- ParallelTerminationStrategy: PID 14193 died... 20:54:30.611457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14193): Terminated: ok {rc=0} 20:54:30.699000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 20:54:31.854850 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:31.867956 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:31.920209 tst iperf3m4.py: using LAC 23661 20:54:32.077748 tst iperf3m4.py: using RAC 201 20:54:32.221420 tst iperf3m4.py: using CellId 23661 20:54:32.344800 tst iperf3m4.py: using BVCI 23662 20:54:32.455238 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.466370 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.477141 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.488171 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.498895 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.509881 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.520862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.531635 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:32.542644 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:32.663329 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:32.785378 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:32.903733 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:33.026256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:54:33.246467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:33.573646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Launched 20:54:33.857084 run iperf3-srv_10.42.42.10(pid=14196): Launched 20:54:33.981045 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:54:34.200452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:34.528466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Launched 20:54:34.812047 run iperf3-srv_10.42.42.10(pid=14198): Launched 20:54:34.934034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:54:35.153551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:35.480807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14199): Launched 20:54:35.763986 run iperf3-srv_10.42.42.10(pid=14200): Launched 20:54:35.885260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:54:36.104291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:54:36.430261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14201): Launched 20:54:36.714864 run iperf3-srv_10.42.42.10(pid=14202): Launched 20:54:36.837967 tst iperf3m4.py:8: start network... 20:54:37.056705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:37.563350 run create_hlr_db(pid=14203): Launched 20:54:37.695501 bus /gobi_6: Setting Powered False 20:54:38.759891 run create_hlr_db(pid=14203): Terminated: ok {rc=0} 20:54:39.192393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14205): Launched 20:54:39.496740 run osmo-hlr_10.42.42.2(pid=14206): Launched 20:54:39.613828 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:40.154385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Launched 20:54:40.458433 run osmo-stp_10.42.42.5(pid=14209): Launched 20:54:40.575829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:41.098102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14211): Launched 20:54:41.215455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:41.471818 run patchelf(pid=14212): Launched 20:54:41.640296 run osmo-stp_10.42.42.5(pid=14209): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14209)] 20:54:41.769074 run osmo-stp_10.42.42.5(pid=14209): stdout: | (launched: 2022-12-09_20:54:40.402072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:41.899493 run osmo-stp_10.42.42.5(pid=14209): stderr: | 20221209205440573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205440573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205440573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205440573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205440574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205440574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205440574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:42.029690 run osmo-stp_10.42.42.5(pid=14209): stdout: | (launched: 2022-12-09_20:54:40.402072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:42.154783 run osmo-stp_10.42.42.5(pid=14209): stderr: | 20221209205440573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205440573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205440573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205440573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205440574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205440574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205440574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:42.302878 run patchelf(pid=14212): Terminating (SIGINT) 20:54:42.473273 run patchelf(pid=14212): Terminated: ok {rc=0} 20:54:42.597292 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14209): Process ended prematurely: osmo-stp_10.42.42.5(pid=14209) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14209)] [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 20:54:42.606812 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:54:42.634970 run osmo-hlr_10.42.42.2(pid=14206): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14206)] 20:54:42.683057 run osmo-hlr_10.42.42.2(pid=14206): stdout: | (launched: 2022-12-09_20:54:39.440769) 20:54:42.732592 run osmo-hlr_10.42.42.2(pid=14206): stderr: | 20221209205439617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205439617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205439617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205439617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205439617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205439617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205439629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205439638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205439638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205439638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:42.782596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Terminating (SIGTERM) 20:54:42.822237 run iperf3-srv_10.42.42.10(pid=14196): Terminating (SIGTERM) 20:54:42.861987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Terminating (SIGTERM) 20:54:42.901865 run iperf3-srv_10.42.42.10(pid=14198): Terminating (SIGTERM) 20:54:42.942857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14199): Terminating (SIGTERM) 20:54:42.983331 run iperf3-srv_10.42.42.10(pid=14200): Terminating (SIGTERM) 20:54:43.023106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14201): Terminating (SIGTERM) 20:54:43.063146 run iperf3-srv_10.42.42.10(pid=14202): Terminating (SIGTERM) 20:54:43.102816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14205): Terminating (SIGTERM) 20:54:43.142613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Terminating (SIGTERM) 20:54:43.182477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14211): Terminating (SIGTERM) 20:54:43.222609 --- ParallelTerminationStrategy: PID 14195 died... 20:54:43.241679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14195): Terminated: ok {rc=0} 20:54:43.286437 --- ParallelTerminationStrategy: PID 14196 died... 20:54:43.305111 run iperf3-srv_10.42.42.10(pid=14196): Terminated {rc=256} 20:54:43.349173 --- ParallelTerminationStrategy: PID 14197 died... 20:54:43.367705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14197): Terminated: ok {rc=0} 20:54:43.412004 --- ParallelTerminationStrategy: PID 14198 died... 20:54:43.430667 run iperf3-srv_10.42.42.10(pid=14198): Terminated {rc=256} 20:54:43.474957 --- ParallelTerminationStrategy: PID 14199 died... 20:54:43.493594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14199): Terminated: ok {rc=0} 20:54:43.537765 --- ParallelTerminationStrategy: PID 14200 died... 20:54:43.556374 run iperf3-srv_10.42.42.10(pid=14200): Terminated {rc=256} 20:54:43.600697 --- ParallelTerminationStrategy: PID 14201 died... 20:54:43.619359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14201): Terminated: ok {rc=0} 20:54:43.664002 --- ParallelTerminationStrategy: PID 14202 died... 20:54:43.682730 run iperf3-srv_10.42.42.10(pid=14202): Terminated {rc=256} 20:54:43.726694 --- ParallelTerminationStrategy: PID 14205 died... 20:54:43.745389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14205): Terminated: ok {rc=0} 20:54:43.789634 --- ParallelTerminationStrategy: PID 14208 died... 20:54:43.808134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Terminated: ok {rc=0} 20:54:43.852818 --- ParallelTerminationStrategy: PID 14211 died... 20:54:43.871698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14211): Terminated: ok {rc=0} 20:54:43.956314 bus /gobi_4: Setting Powered False 20:54:45.055383 bus /gobi_4: Setting Powered False 20:54:46.172526 bus /gobi_1: Setting Powered False 20:54:47.272504 bus /gobi_1: Setting Powered False 20:54:48.387178 bus /gobi_0: Setting Powered False 20:54:49.485145 bus /gobi_0: Setting Powered False 20:54:50.600366 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 20:54:51.704354 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:51.716409 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:51.769251 tst ping.py: using LAC 23662 20:54:51.888797 tst ping.py: using RAC 202 20:54:52.014189 tst ping.py: using CellId 23662 20:54:52.142490 tst ping.py: using BVCI 23663 20:54:52.259774 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.271460 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.282803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.294069 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.305410 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.316592 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.328010 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:52.339309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:54:52.458270 tst ping.py:19: start network... 20:54:52.673085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:54:53.165208 run create_hlr_db(pid=14214): Launched 20:54:53.294618 bus /gobi_6: Setting Powered False 20:54:54.357941 run create_hlr_db(pid=14214): Terminated: ok {rc=0} 20:54:54.784804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Launched 20:54:55.084093 run osmo-hlr_10.42.42.2(pid=14217): Launched 20:54:55.198138 run osmo-stp_10.42.42.5: Starting osmo-stp 20:54:55.716925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Launched 20:54:56.014833 run osmo-stp_10.42.42.5(pid=14220): Launched 20:54:56.128577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:54:56.643537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Launched 20:54:56.758080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:54:57.010988 run patchelf(pid=14223): Launched 20:54:57.178303 run osmo-stp_10.42.42.5(pid=14220): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] 20:54:57.304600 run osmo-stp_10.42.42.5(pid=14220): stdout: | (launched: 2022-12-09_20:54:55.959919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:57.432872 run osmo-stp_10.42.42.5(pid=14220): stderr: | 20221209205456129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205456130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205456130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205456130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205456131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205456131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205456131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:57.561823 run osmo-stp_10.42.42.5(pid=14220): stdout: | (launched: 2022-12-09_20:54:55.959919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:54:57.684091 run osmo-stp_10.42.42.5(pid=14220): stderr: | 20221209205456129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205456130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205456130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205456130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205456131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205456131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205456131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:54:57.829658 run patchelf(pid=14223): Terminating (SIGINT) 20:54:57.996763 run patchelf(pid=14223): Terminated: ok {rc=0} 20:54:58.117606 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14220): Process ended prematurely: osmo-stp_10.42.42.5(pid=14220) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 20:54:58.126596 tst ping.py:22: Test FAILED (6.4 sec) 20:54:58.153396 run osmo-hlr_10.42.42.2(pid=14217): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14217)] 20:54:58.201324 run osmo-hlr_10.42.42.2(pid=14217): stdout: | (launched: 2022-12-09_20:54:55.029087) 20:54:58.250470 run osmo-hlr_10.42.42.2(pid=14217): stderr: | 20221209205455204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205455204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205455204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205455204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205455204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205455204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205455217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205455225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205455226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205455226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:54:58.300064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Terminating (SIGTERM) 20:54:58.339433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Terminating (SIGTERM) 20:54:58.378809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Terminating (SIGTERM) 20:54:58.418427 --- ParallelTerminationStrategy: PID 14216 died... 20:54:58.437477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14216): Terminated: ok {rc=0} 20:54:58.481637 --- ParallelTerminationStrategy: PID 14219 died... 20:54:58.500047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14219): Terminated: ok {rc=0} 20:54:58.544674 --- ParallelTerminationStrategy: PID 14222 died... 20:54:58.563183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14222): Terminated: ok {rc=0} 20:54:58.648450 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 20:54:59.736767 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:54:59.748880 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 20:54:59.804057 tst ping_idle_ping.py: using LAC 23663 20:54:59.925381 tst ping_idle_ping.py: using RAC 203 20:55:00.045814 tst ping_idle_ping.py: using CellId 23663 20:55:00.163317 tst ping_idle_ping.py: using BVCI 23664 20:55:00.272557 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.283587 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.294447 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.305501 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.316639 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.327577 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.338780 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 20:55:00.349811 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 20:55:00.464510 tst ping_idle_ping.py:24: start network... 20:55:00.665159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:01.184941 run create_hlr_db(pid=14224): Launched 20:55:01.335312 bus /gobi_6: Setting Powered False 20:55:02.398924 run create_hlr_db(pid=14224): Terminated: ok {rc=0} 20:55:02.831395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14229): Launched 20:55:03.131532 run osmo-hlr_10.42.42.2(pid=14230): Launched 20:55:03.244763 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:03.775084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14232): Launched 20:55:04.075587 run osmo-stp_10.42.42.5(pid=14233): Launched 20:55:04.190030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:04.710209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14235): Launched 20:55:04.824908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:05.078460 run patchelf(pid=14236): Launched 20:55:05.244627 run osmo-stp_10.42.42.5(pid=14233): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14233)] 20:55:05.371137 run osmo-stp_10.42.42.5(pid=14233): stdout: | (launched: 2022-12-09_20:55:04.020092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:05.499604 run osmo-stp_10.42.42.5(pid=14233): stderr: | 20221209205504191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205504191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205504192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205504192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205504193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205504193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205504193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:05.628100 run osmo-stp_10.42.42.5(pid=14233): stdout: | (launched: 2022-12-09_20:55:04.020092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:05.750932 run osmo-stp_10.42.42.5(pid=14233): stderr: | 20221209205504191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205504191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205504192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205504192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205504193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205504193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205504193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:05.896397 run patchelf(pid=14236): Terminating (SIGINT) 20:55:06.063915 run patchelf(pid=14236): Terminated: ok {rc=0} 20:55:06.186599 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14233): Process ended prematurely: osmo-stp_10.42.42.5(pid=14233) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14233)] [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 20:55:06.195627 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 20:55:06.223064 run osmo-hlr_10.42.42.2(pid=14230): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14230)] 20:55:06.270229 run osmo-hlr_10.42.42.2(pid=14230): stdout: | (launched: 2022-12-09_20:55:03.076204) 20:55:06.319383 run osmo-hlr_10.42.42.2(pid=14230): stderr: | 20221209205503255 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205503255 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205503256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205503256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205503256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205503256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205503269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205503279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205503279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205503279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:06.369435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14229): Terminating (SIGTERM) 20:55:06.409065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14232): Terminating (SIGTERM) 20:55:06.448897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14235): Terminating (SIGTERM) 20:55:06.489208 --- ParallelTerminationStrategy: PID 14229 died... 20:55:06.508377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14229): Terminated: ok {rc=0} 20:55:06.552651 --- ParallelTerminationStrategy: PID 14232 died... 20:55:06.571297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14232): Terminated: ok {rc=0} 20:55:06.615345 --- ParallelTerminationStrategy: PID 14235 died... 20:55:06.633884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14235): Terminated: ok {rc=0} 20:55:06.719694 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 20:55:08.032326 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:55:08.039172 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 20:55:08.072635 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 20:55:08.110999 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 20:55:08.198698 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 20:55:08.231676 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 20:55:08.269923 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 20:55:08.866954 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 20:55:08.921392 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:08.932655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:09.004387 tst cs_paging_gprs_active.py: using LAC 23664 20:55:09.135731 tst cs_paging_gprs_active.py: using RAC 204 20:55:09.266075 tst cs_paging_gprs_active.py: using CellId 23664 20:55:09.391572 tst cs_paging_gprs_active.py: using BVCI 23665 20:55:09.509786 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.521090 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.532399 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.543662 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.554728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.565917 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.577142 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.588155 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:09.599439 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:09.720612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:09.844075 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:55:10.064643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:10.392210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14241): Launched 20:55:10.675785 run iperf3-srv_10.42.42.10(pid=14242): Launched 20:55:10.798970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:55:11.019391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:11.348402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14243): Launched 20:55:11.633501 run iperf3-srv_10.42.42.10(pid=14244): Launched 20:55:11.757351 tst cs_paging_gprs_active.py:38: start network... 20:55:11.976575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:12.482063 run create_hlr_db(pid=14245): Launched 20:55:12.614304 bus /gobi_6: Setting Powered False 20:55:13.678331 run create_hlr_db(pid=14245): Terminated: ok {rc=0} 20:55:14.111939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Launched 20:55:14.417103 run osmo-hlr_10.42.42.2(pid=14248): Launched 20:55:14.533378 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:15.071994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Launched 20:55:15.375413 run osmo-stp_10.42.42.5(pid=14251): Launched 20:55:15.491358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:16.039674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14253): Launched 20:55:16.204462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:16.496350 run patchelf(pid=14254): Launched 20:55:16.693984 run osmo-stp_10.42.42.5(pid=14251): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] 20:55:16.837961 run osmo-stp_10.42.42.5(pid=14251): stdout: | (launched: 2022-12-09_20:55:15.319681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:16.981925 run osmo-stp_10.42.42.5(pid=14251): stderr: | 20221209205515488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205515488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205515488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205515489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205515489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205515489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205515489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:17.124060 run osmo-stp_10.42.42.5(pid=14251): stdout: | (launched: 2022-12-09_20:55:15.319681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:17.262344 run osmo-stp_10.42.42.5(pid=14251): stderr: | 20221209205515488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205515488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205515488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205515489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205515489 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205515489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205515489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:17.420285 run patchelf(pid=14254): Terminating (SIGINT) 20:55:17.603516 run patchelf(pid=14254): Terminated: ok {rc=0} 20:55:17.736044 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14251): Process ended prematurely: osmo-stp_10.42.42.5(pid=14251) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 20:55:17.746703 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 20:55:17.775840 run osmo-hlr_10.42.42.2(pid=14248): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14248)] 20:55:17.826326 run osmo-hlr_10.42.42.2(pid=14248): stdout: | (launched: 2022-12-09_20:55:14.360670) 20:55:17.878380 run osmo-hlr_10.42.42.2(pid=14248): stderr: | 20221209205514536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205514536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205514536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205514536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205514536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205514536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205514549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205514557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205514557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205514557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:17.930718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14241): Terminating (SIGTERM) 20:55:17.972483 run iperf3-srv_10.42.42.10(pid=14242): Terminating (SIGTERM) 20:55:18.014308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14243): Terminating (SIGTERM) 20:55:18.056065 run iperf3-srv_10.42.42.10(pid=14244): Terminating (SIGTERM) 20:55:18.097726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Terminating (SIGTERM) 20:55:18.139472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Terminating (SIGTERM) 20:55:18.181155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14253): Terminating (SIGTERM) 20:55:18.223070 --- ParallelTerminationStrategy: PID 14241 died... 20:55:18.242936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14241): Terminated: ok {rc=0} 20:55:18.289068 --- ParallelTerminationStrategy: PID 14242 died... 20:55:18.308703 run iperf3-srv_10.42.42.10(pid=14242): Terminated {rc=256} 20:55:18.354874 --- ParallelTerminationStrategy: PID 14243 died... 20:55:18.374603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14243): Terminated: ok {rc=0} 20:55:18.420895 --- ParallelTerminationStrategy: PID 14244 died... 20:55:18.440853 run iperf3-srv_10.42.42.10(pid=14244): Terminated {rc=256} 20:55:18.487221 --- ParallelTerminationStrategy: PID 14247 died... 20:55:18.507033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14247): Terminated: ok {rc=0} 20:55:18.553272 --- ParallelTerminationStrategy: PID 14250 died... 20:55:18.572843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14250): Terminated: ok {rc=0} 20:55:18.619404 --- ParallelTerminationStrategy: PID 14253 died... 20:55:18.639090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14253): Terminated: ok {rc=0} 20:55:18.728085 bus /gobi_0: Setting Powered False 20:55:19.825532 bus /gobi_0: Setting Powered False 20:55:20.940177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 20:55:22.089898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.101876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:22.173051 tst iperf3.py: using LAC 23665 20:55:22.299724 tst iperf3.py: using RAC 205 20:55:22.420301 tst iperf3.py: using CellId 23665 20:55:22.543119 tst iperf3.py: using BVCI 23666 20:55:22.654805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.665970 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.676688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.687690 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.698564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.709409 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.720234 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.731149 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:22.742127 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:22.862355 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:55:23.083170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:23.410374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14255): Launched 20:55:23.696045 run iperf3-srv_10.42.42.10(pid=14256): Launched 20:55:23.811817 tst iperf3.py:8: start network... 20:55:24.017105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:24.491900 run create_hlr_db(pid=14257): Launched 20:55:24.607929 bus /gobi_6: Setting Powered False 20:55:25.669448 run create_hlr_db(pid=14257): Terminated: ok {rc=0} 20:55:26.094751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Launched 20:55:26.398974 run osmo-hlr_10.42.42.2(pid=14260): Launched 20:55:26.515527 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:27.053031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Launched 20:55:27.357740 run osmo-stp_10.42.42.5(pid=14263): Launched 20:55:27.474827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:28.002587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14265): Launched 20:55:28.118521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:28.374832 run patchelf(pid=14266): Launched 20:55:28.543452 run osmo-stp_10.42.42.5(pid=14263): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] 20:55:28.672090 run osmo-stp_10.42.42.5(pid=14263): stdout: | (launched: 2022-12-09_20:55:27.301238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:28.802712 run osmo-stp_10.42.42.5(pid=14263): stderr: | 20221209205527472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205527472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205527472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205527472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205527473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205527473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205527473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:28.933547 run osmo-stp_10.42.42.5(pid=14263): stdout: | (launched: 2022-12-09_20:55:27.301238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:29.058271 run osmo-stp_10.42.42.5(pid=14263): stderr: | 20221209205527472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205527472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205527472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205527472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205527473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205527473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205527473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:29.206258 run patchelf(pid=14266): Terminating (SIGINT) 20:55:29.376659 run patchelf(pid=14266): Terminated: ok {rc=0} 20:55:29.500094 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14263): Process ended prematurely: osmo-stp_10.42.42.5(pid=14263) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 20:55:29.509773 tst iperf3.py:8: Test FAILED (7.5 sec) 20:55:29.537842 run osmo-hlr_10.42.42.2(pid=14260): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14260)] 20:55:29.585966 run osmo-hlr_10.42.42.2(pid=14260): stdout: | (launched: 2022-12-09_20:55:26.342477) 20:55:29.635604 run osmo-hlr_10.42.42.2(pid=14260): stderr: | 20221209205526518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205526518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205526518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205526518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205526518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205526518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205526532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205526542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205526542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205526542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:29.685925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14255): Terminating (SIGTERM) 20:55:29.726007 run iperf3-srv_10.42.42.10(pid=14256): Terminating (SIGTERM) 20:55:29.765965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Terminating (SIGTERM) 20:55:29.805993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminating (SIGTERM) 20:55:29.845888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14265): Terminating (SIGTERM) 20:55:29.886097 --- ParallelTerminationStrategy: PID 14255 died... 20:55:29.905336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14255): Terminated: ok {rc=0} 20:55:29.949920 --- ParallelTerminationStrategy: PID 14256 died... 20:55:29.968406 run iperf3-srv_10.42.42.10(pid=14256): Terminated {rc=256} 20:55:30.012122 --- ParallelTerminationStrategy: PID 14259 died... 20:55:30.030672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14259): Terminated: ok {rc=0} 20:55:30.074460 --- ParallelTerminationStrategy: PID 14262 died... 20:55:30.092739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminated: ok {rc=0} 20:55:30.137690 --- ParallelTerminationStrategy: PID 14265 died... 20:55:30.156501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14265): Terminated: ok {rc=0} 20:55:30.243126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 20:55:31.426239 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:31.442462 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:31.531340 tst iperf3m4.py: using LAC 23666 20:55:31.653906 tst iperf3m4.py: using RAC 206 20:55:31.806259 tst iperf3m4.py: using CellId 23666 20:55:31.935971 tst iperf3m4.py: using BVCI 23667 20:55:32.049549 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.061490 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.074050 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.085828 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.098705 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.112564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.125576 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.137214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:32.150134 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:32.271201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:32.391796 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:32.512497 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:32.629397 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:55:32.835017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:33.141888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14267): Launched 20:55:33.407186 run iperf3-srv_10.42.42.10(pid=14268): Launched 20:55:33.521790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:55:33.726369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:34.032721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14269): Launched 20:55:34.298510 run iperf3-srv_10.42.42.10(pid=14270): Launched 20:55:34.412419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:55:34.616540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:34.922290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14271): Launched 20:55:35.186685 run iperf3-srv_10.42.42.10(pid=14272): Launched 20:55:35.309158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:55:35.529081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:55:35.857337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14273): Launched 20:55:36.140717 run iperf3-srv_10.42.42.10(pid=14274): Launched 20:55:36.262658 tst iperf3m4.py:8: start network... 20:55:36.482467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:36.988410 run create_hlr_db(pid=14275): Launched 20:55:37.121287 bus /gobi_6: Setting Powered False 20:55:38.184892 run create_hlr_db(pid=14275): Terminated: ok {rc=0} 20:55:38.637349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Launched 20:55:38.958479 run osmo-hlr_10.42.42.2(pid=14278): Launched 20:55:39.081139 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:39.637291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14280): Launched 20:55:39.957740 run osmo-stp_10.42.42.5(pid=14281): Launched 20:55:40.079588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:40.631341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14283): Launched 20:55:40.753809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:41.024312 run patchelf(pid=14284): Launched 20:55:41.202349 run osmo-stp_10.42.42.5(pid=14281): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14281)] 20:55:41.337221 run osmo-stp_10.42.42.5(pid=14281): stdout: | (launched: 2022-12-09_20:55:39.897821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:41.473196 run osmo-stp_10.42.42.5(pid=14281): stderr: | 20221209205540086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205540086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205540087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205540087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205540088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205540088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205540088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:41.609596 run osmo-stp_10.42.42.5(pid=14281): stdout: | (launched: 2022-12-09_20:55:39.897821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:41.740317 run osmo-stp_10.42.42.5(pid=14281): stderr: | 20221209205540086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205540086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205540087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205540087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205540088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205540088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205540088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:41.895920 run patchelf(pid=14284): Terminating (SIGINT) 20:55:42.074444 run patchelf(pid=14284): Terminated: ok {rc=0} 20:55:42.202994 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14281): Process ended prematurely: osmo-stp_10.42.42.5(pid=14281) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14281)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 20:55:42.213158 tst iperf3m4.py:8: Test FAILED (10.8 sec) 20:55:42.241821 run osmo-hlr_10.42.42.2(pid=14278): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14278)] 20:55:42.292082 run osmo-hlr_10.42.42.2(pid=14278): stdout: | (launched: 2022-12-09_20:55:38.899371) 20:55:42.343842 run osmo-hlr_10.42.42.2(pid=14278): stderr: | 20221209205539093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205539094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205539094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205539094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205539094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205539094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205539107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205539117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205539117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205539117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:42.395809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14267): Terminating (SIGTERM) 20:55:42.437117 run iperf3-srv_10.42.42.10(pid=14268): Terminating (SIGTERM) 20:55:42.478456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14269): Terminating (SIGTERM) 20:55:42.519808 run iperf3-srv_10.42.42.10(pid=14270): Terminating (SIGTERM) 20:55:42.561393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14271): Terminating (SIGTERM) 20:55:42.602796 run iperf3-srv_10.42.42.10(pid=14272): Terminating (SIGTERM) 20:55:42.644304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14273): Terminating (SIGTERM) 20:55:42.685707 run iperf3-srv_10.42.42.10(pid=14274): Terminating (SIGTERM) 20:55:42.726957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Terminating (SIGTERM) 20:55:42.768346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14280): Terminating (SIGTERM) 20:55:42.809979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14283): Terminating (SIGTERM) 20:55:42.851886 --- ParallelTerminationStrategy: PID 14267 died... 20:55:42.872016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14267): Terminated: ok {rc=0} 20:55:42.918541 --- ParallelTerminationStrategy: PID 14268 died... 20:55:42.938327 run iperf3-srv_10.42.42.10(pid=14268): Terminated {rc=256} 20:55:42.984316 --- ParallelTerminationStrategy: PID 14269 died... 20:55:43.004065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14269): Terminated: ok {rc=0} 20:55:43.050805 --- ParallelTerminationStrategy: PID 14270 died... 20:55:43.070453 run iperf3-srv_10.42.42.10(pid=14270): Terminated {rc=256} 20:55:43.116690 --- ParallelTerminationStrategy: PID 14271 died... 20:55:43.136413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14271): Terminated: ok {rc=0} 20:55:43.182403 --- ParallelTerminationStrategy: PID 14272 died... 20:55:43.202068 run iperf3-srv_10.42.42.10(pid=14272): Terminated {rc=256} 20:55:43.248029 --- ParallelTerminationStrategy: PID 14273 died... 20:55:43.267506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14273): Terminated: ok {rc=0} 20:55:43.313666 --- ParallelTerminationStrategy: PID 14274 died... 20:55:43.333415 run iperf3-srv_10.42.42.10(pid=14274): Terminated {rc=256} 20:55:43.379433 --- ParallelTerminationStrategy: PID 14277 died... 20:55:43.399116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14277): Terminated: ok {rc=0} 20:55:43.445139 --- ParallelTerminationStrategy: PID 14280 died... 20:55:43.464658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14280): Terminated: ok {rc=0} 20:55:43.510761 --- ParallelTerminationStrategy: PID 14283 died... 20:55:43.530620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14283): Terminated: ok {rc=0} 20:55:43.617838 bus /gobi_4: Setting Powered False 20:55:44.716865 bus /gobi_4: Setting Powered False 20:55:45.832409 bus /gobi_1: Setting Powered False 20:55:46.928686 bus /gobi_1: Setting Powered False 20:55:48.050075 bus /gobi_0: Setting Powered False 20:55:49.148693 bus /gobi_0: Setting Powered False 20:55:50.262798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 20:55:51.365773 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.377644 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:51.448316 tst ping.py: using LAC 23667 20:55:51.570396 tst ping.py: using RAC 207 20:55:51.693374 tst ping.py: using CellId 23667 20:55:51.815691 tst ping.py: using BVCI 23668 20:55:51.930243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.941576 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.952350 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.963544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.974408 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.985306 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:51.996261 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:52.007198 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:55:52.122714 tst ping.py:19: start network... 20:55:52.331541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:55:52.812765 run create_hlr_db(pid=14285): Launched 20:55:52.939119 bus /gobi_6: Setting Powered False 20:55:54.001052 run create_hlr_db(pid=14285): Terminated: ok {rc=0} 20:55:54.417024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14287): Launched 20:55:54.708316 run osmo-hlr_10.42.42.2(pid=14288): Launched 20:55:54.818810 run osmo-stp_10.42.42.5: Starting osmo-stp 20:55:55.333263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14290): Launched 20:55:55.623017 run osmo-stp_10.42.42.5(pid=14291): Launched 20:55:55.732768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:55:56.230475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14293): Launched 20:55:56.341350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:55:56.585959 run patchelf(pid=14294): Launched 20:55:56.745966 run osmo-stp_10.42.42.5(pid=14291): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14291)] 20:55:56.868476 run osmo-stp_10.42.42.5(pid=14291): stdout: | (launched: 2022-12-09_20:55:55.569837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:56.992517 run osmo-stp_10.42.42.5(pid=14291): stderr: | 20221209205555736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205555736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205555736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205555736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205555737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205555737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205555737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:57.116402 run osmo-stp_10.42.42.5(pid=14291): stdout: | (launched: 2022-12-09_20:55:55.569837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:55:57.235967 run osmo-stp_10.42.42.5(pid=14291): stderr: | 20221209205555736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205555736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205555736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205555736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205555737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205555737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205555737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:55:57.376469 run patchelf(pid=14294): Terminating (SIGINT) 20:55:57.539373 run patchelf(pid=14294): Terminated: ok {rc=0} 20:55:57.656691 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14291): Process ended prematurely: osmo-stp_10.42.42.5(pid=14291) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14291)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 20:55:57.665559 tst ping.py:22: Test FAILED (6.3 sec) 20:55:57.692660 run osmo-hlr_10.42.42.2(pid=14288): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14288)] 20:55:57.740580 run osmo-hlr_10.42.42.2(pid=14288): stdout: | (launched: 2022-12-09_20:55:54.654921) 20:55:57.790118 run osmo-hlr_10.42.42.2(pid=14288): stderr: | 20221209205554823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205554824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205554824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205554824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205554824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205554824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205554834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205554843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205554843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205554843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:55:57.840093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14287): Terminating (SIGTERM) 20:55:57.879814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14290): Terminating (SIGTERM) 20:55:57.919628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14293): Terminating (SIGTERM) 20:55:57.959925 --- ParallelTerminationStrategy: PID 14287 died... 20:55:57.979082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14287): Terminated: ok {rc=0} 20:55:58.023899 --- ParallelTerminationStrategy: PID 14290 died... 20:55:58.042535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14290): Terminated: ok {rc=0} 20:55:58.086654 --- ParallelTerminationStrategy: PID 14293 died... 20:55:58.105438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14293): Terminated: ok {rc=0} 20:55:58.193326 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 20:55:59.280645 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.292429 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 20:55:59.361388 tst ping_idle_ping.py: using LAC 23668 20:55:59.474394 tst ping_idle_ping.py: using RAC 208 20:55:59.587606 tst ping_idle_ping.py: using CellId 23668 20:55:59.700657 tst ping_idle_ping.py: using BVCI 23669 20:55:59.806792 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.817824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.828484 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.839711 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.850730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.861955 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.873183 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 20:55:59.883893 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 20:56:00.002419 tst ping_idle_ping.py:24: start network... 20:56:00.212872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:00.699275 run create_hlr_db(pid=14295): Launched 20:56:00.828413 bus /gobi_6: Setting Powered False 20:56:01.890629 run create_hlr_db(pid=14295): Terminated: ok {rc=0} 20:56:02.329482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14297): Launched 20:56:02.622097 run osmo-hlr_10.42.42.2(pid=14298): Launched 20:56:02.732578 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:03.247936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14300): Launched 20:56:03.537081 run osmo-stp_10.42.42.5(pid=14301): Launched 20:56:03.646857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:04.146375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14303): Launched 20:56:04.265579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:04.528749 run patchelf(pid=14304): Launched 20:56:04.701928 run osmo-stp_10.42.42.5(pid=14301): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14301)] 20:56:04.833993 run osmo-stp_10.42.42.5(pid=14301): stdout: | (launched: 2022-12-09_20:56:03.483655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:04.967619 run osmo-stp_10.42.42.5(pid=14301): stderr: | 20221209205603649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205603649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205603649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205603650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205603650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205603650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205603650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:05.101497 run osmo-stp_10.42.42.5(pid=14301): stdout: | (launched: 2022-12-09_20:56:03.483655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:05.229733 run osmo-stp_10.42.42.5(pid=14301): stderr: | 20221209205603649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205603649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205603649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205603650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205603650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205603650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205603650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:05.381043 run patchelf(pid=14304): Terminating (SIGINT) 20:56:05.555228 run patchelf(pid=14304): Terminated: ok {rc=0} 20:56:05.680279 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14301): Process ended prematurely: osmo-stp_10.42.42.5(pid=14301) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14301)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 20:56:05.689734 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 20:56:05.717547 run osmo-hlr_10.42.42.2(pid=14298): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14298)] 20:56:05.767585 run osmo-hlr_10.42.42.2(pid=14298): stdout: | (launched: 2022-12-09_20:56:02.568466) 20:56:05.818814 run osmo-hlr_10.42.42.2(pid=14298): stderr: | 20221209205602738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205602738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205602738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205602739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205602739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205602739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205602751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205602760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205602760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205602760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:05.870345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14297): Terminating (SIGTERM) 20:56:05.911778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14300): Terminating (SIGTERM) 20:56:05.953501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14303): Terminating (SIGTERM) 20:56:05.995220 --- ParallelTerminationStrategy: PID 14297 died... 20:56:06.015266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14297): Terminated: ok {rc=0} 20:56:06.061738 --- ParallelTerminationStrategy: PID 14300 died... 20:56:06.081549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14300): Terminated: ok {rc=0} 20:56:06.127451 --- ParallelTerminationStrategy: PID 14303 died... 20:56:06.147153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14303): Terminated: ok {rc=0} 20:56:06.234913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 20:56:07.535591 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:56:07.541833 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 20:56:07.576610 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 20:56:07.616015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 20:56:07.704686 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 20:56:07.739224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 20:56:07.778925 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 20:56:08.369901 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 20:56:08.421655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:08.432687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:08.503782 tst cs_paging_gprs_active.py: using LAC 23669 20:56:08.641748 tst cs_paging_gprs_active.py: using RAC 209 20:56:08.769788 tst cs_paging_gprs_active.py: using CellId 23669 20:56:08.895568 tst cs_paging_gprs_active.py: using BVCI 23670 20:56:09.009129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.019864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.030591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.041795 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.052825 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.064016 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.075347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.086388 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:09.097701 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:09.211880 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:09.336006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 20:56:09.537270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:09.833111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14308): Launched 20:56:10.089535 run iperf3-srv_10.42.42.10(pid=14309): Launched 20:56:10.200162 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 20:56:10.398019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:10.693339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14310): Launched 20:56:10.949575 run iperf3-srv_10.42.42.10(pid=14311): Launched 20:56:11.059458 tst cs_paging_gprs_active.py:38: start network... 20:56:11.257304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:11.712877 run create_hlr_db(pid=14312): Launched 20:56:11.824907 bus /gobi_6: Setting Powered False 20:56:12.884135 run create_hlr_db(pid=14312): Terminated: ok {rc=0} 20:56:13.293612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Launched 20:56:13.586520 run osmo-hlr_10.42.42.2(pid=14315): Launched 20:56:13.697372 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:14.210551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Launched 20:56:14.502986 run osmo-stp_10.42.42.5(pid=14318): Launched 20:56:14.614139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:15.118756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14320): Launched 20:56:15.231267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:15.479081 run patchelf(pid=14321): Launched 20:56:15.644677 run osmo-stp_10.42.42.5(pid=14318): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] 20:56:15.770601 run osmo-stp_10.42.42.5(pid=14318): stdout: | (launched: 2022-12-09_20:56:14.449641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:15.921813 run osmo-stp_10.42.42.5(pid=14318): stderr: | 20221209205614616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205614616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205614616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205614617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205614617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205614618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205614618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:16.071264 run osmo-stp_10.42.42.5(pid=14318): stdout: | (launched: 2022-12-09_20:56:14.449641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:16.228208 run osmo-stp_10.42.42.5(pid=14318): stderr: | 20221209205614616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205614616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205614616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205614617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205614617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205614618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205614618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:16.384541 run patchelf(pid=14321): Terminating (SIGINT) 20:56:16.558185 run patchelf(pid=14321): Terminated: ok {rc=0} 20:56:16.683056 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14318): Process ended prematurely: osmo-stp_10.42.42.5(pid=14318) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 20:56:16.693730 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 20:56:16.724124 run osmo-hlr_10.42.42.2(pid=14315): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14315)] 20:56:16.774960 run osmo-hlr_10.42.42.2(pid=14315): stdout: | (launched: 2022-12-09_20:56:13.533347) 20:56:16.826355 run osmo-hlr_10.42.42.2(pid=14315): stderr: | 20221209205613704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205613704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205613704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205613704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205613704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205613704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205613716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205613724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205613725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205613725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:16.878012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14308): Terminating (SIGTERM) 20:56:16.919591 run iperf3-srv_10.42.42.10(pid=14309): Terminating (SIGTERM) 20:56:16.962281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14310): Terminating (SIGTERM) 20:56:17.004025 run iperf3-srv_10.42.42.10(pid=14311): Terminating (SIGTERM) 20:56:17.045702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Terminating (SIGTERM) 20:56:17.087011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Terminating (SIGTERM) 20:56:17.128699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14320): Terminating (SIGTERM) 20:56:17.171218 --- ParallelTerminationStrategy: PID 14308 died... 20:56:17.190457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14308): Terminated: ok {rc=0} 20:56:17.236299 --- ParallelTerminationStrategy: PID 14309 died... 20:56:17.255904 run iperf3-srv_10.42.42.10(pid=14309): Terminated {rc=256} 20:56:17.300734 --- ParallelTerminationStrategy: PID 14310 died... 20:56:17.319368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14310): Terminated: ok {rc=0} 20:56:17.363719 --- ParallelTerminationStrategy: PID 14311 died... 20:56:17.382021 run iperf3-srv_10.42.42.10(pid=14311): Terminated {rc=256} 20:56:17.426038 --- ParallelTerminationStrategy: PID 14314 died... 20:56:17.444363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14314): Terminated: ok {rc=0} 20:56:17.488625 --- ParallelTerminationStrategy: PID 14317 died... 20:56:17.507150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14317): Terminated: ok {rc=0} 20:56:17.551475 --- ParallelTerminationStrategy: PID 14320 died... 20:56:17.569854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14320): Terminated: ok {rc=0} 20:56:17.654972 bus /gobi_0: Setting Powered False 20:56:18.752912 bus /gobi_0: Setting Powered False 20:56:19.866736 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 20:56:21.011294 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.022722 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:21.091898 tst iperf3.py: using LAC 23670 20:56:21.208551 tst iperf3.py: using RAC 210 20:56:21.325304 tst iperf3.py: using CellId 23670 20:56:21.444784 tst iperf3.py: using BVCI 23671 20:56:21.554552 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.565359 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.575801 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.586288 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.597200 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.607991 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.618827 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.629597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:21.640571 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:21.757984 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 20:56:21.973149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:22.292249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14322): Launched 20:56:22.569354 run iperf3-srv_10.42.42.10(pid=14323): Launched 20:56:22.688898 tst iperf3.py:8: start network... 20:56:22.904433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:23.399007 run create_hlr_db(pid=14324): Launched 20:56:23.529057 bus /gobi_6: Setting Powered False 20:56:24.592453 run create_hlr_db(pid=14324): Terminated: ok {rc=0} 20:56:25.037724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14326): Launched 20:56:25.356268 run osmo-hlr_10.42.42.2(pid=14327): Launched 20:56:25.477302 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:26.034525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14329): Launched 20:56:26.352323 run osmo-stp_10.42.42.5(pid=14330): Launched 20:56:26.473645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:27.024250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14332): Launched 20:56:27.145892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:27.415479 run patchelf(pid=14333): Launched 20:56:27.592374 run osmo-stp_10.42.42.5(pid=14330): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14330)] 20:56:27.726811 run osmo-stp_10.42.42.5(pid=14330): stdout: | (launched: 2022-12-09_20:56:26.294296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:27.863770 run osmo-stp_10.42.42.5(pid=14330): stderr: | 20221209205626481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205626481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205626481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205626481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205626482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205626482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205626482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:27.999673 run osmo-stp_10.42.42.5(pid=14330): stdout: | (launched: 2022-12-09_20:56:26.294296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:28.130607 run osmo-stp_10.42.42.5(pid=14330): stderr: | 20221209205626481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205626481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205626481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205626481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205626482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205626482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205626482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:28.285281 run patchelf(pid=14333): Terminating (SIGINT) 20:56:28.463408 run patchelf(pid=14333): Terminated: ok {rc=0} 20:56:28.592245 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14330): Process ended prematurely: osmo-stp_10.42.42.5(pid=14330) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14330)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 20:56:28.602521 tst iperf3.py:8: Test FAILED (7.6 sec) 20:56:28.631484 run osmo-hlr_10.42.42.2(pid=14327): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14327)] 20:56:28.681380 run osmo-hlr_10.42.42.2(pid=14327): stdout: | (launched: 2022-12-09_20:56:25.298037) 20:56:28.732614 run osmo-hlr_10.42.42.2(pid=14327): stderr: | 20221209205625493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205625493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205625493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205625493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205625493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205625493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205625505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205625514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205625514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205625514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:28.784529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14322): Terminating (SIGTERM) 20:56:28.826155 run iperf3-srv_10.42.42.10(pid=14323): Terminating (SIGTERM) 20:56:28.867600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14326): Terminating (SIGTERM) 20:56:28.909217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14329): Terminating (SIGTERM) 20:56:28.950639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14332): Terminating (SIGTERM) 20:56:28.992635 --- ParallelTerminationStrategy: PID 14322 died... 20:56:29.012590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14322): Terminated: ok {rc=0} 20:56:29.059172 --- ParallelTerminationStrategy: PID 14323 died... 20:56:29.078727 run iperf3-srv_10.42.42.10(pid=14323): Terminated {rc=256} 20:56:29.125071 --- ParallelTerminationStrategy: PID 14326 died... 20:56:29.144511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14326): Terminated: ok {rc=0} 20:56:29.190777 --- ParallelTerminationStrategy: PID 14329 died... 20:56:29.210469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14329): Terminated: ok {rc=0} 20:56:29.256574 --- ParallelTerminationStrategy: PID 14332 died... 20:56:29.276224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14332): Terminated: ok {rc=0} 20:56:29.364300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 20:56:30.509268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:30.520443 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:30.590433 tst iperf3m4.py: using LAC 23671 20:56:30.709309 tst iperf3m4.py: using RAC 211 20:56:30.834409 tst iperf3m4.py: using CellId 23671 20:56:30.975031 tst iperf3m4.py: using BVCI 23672 20:56:31.134837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.152135 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.169972 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.187203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.205018 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.221711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.239112 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.252808 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:31.264548 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:31.382591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:31.502133 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:31.618253 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:31.760815 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 20:56:31.997485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:32.329236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14334): Launched 20:56:32.589255 run iperf3-srv_10.42.42.10(pid=14335): Launched 20:56:32.700798 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 20:56:32.900424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:33.199200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14336): Launched 20:56:33.459216 run iperf3-srv_10.42.42.10(pid=14337): Launched 20:56:33.570485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 20:56:33.770303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:34.069127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14338): Launched 20:56:34.328505 run iperf3-srv_10.42.42.10(pid=14339): Launched 20:56:34.439865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 20:56:34.638387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 20:56:34.937134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14340): Launched 20:56:35.195648 run iperf3-srv_10.42.42.10(pid=14341): Launched 20:56:35.306655 tst iperf3m4.py:8: start network... 20:56:35.505283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:35.964937 run create_hlr_db(pid=14342): Launched 20:56:36.079133 bus /gobi_6: Setting Powered False 20:56:37.138905 run create_hlr_db(pid=14342): Terminated: ok {rc=0} 20:56:37.554547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14344): Launched 20:56:37.851645 run osmo-hlr_10.42.42.2(pid=14345): Launched 20:56:37.964172 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:38.490016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14347): Launched 20:56:38.787157 run osmo-stp_10.42.42.5(pid=14348): Launched 20:56:38.902145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:39.421225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14350): Launched 20:56:39.537191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:39.792757 run patchelf(pid=14351): Launched 20:56:39.960538 run osmo-stp_10.42.42.5(pid=14348): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14348)] 20:56:40.088427 run osmo-stp_10.42.42.5(pid=14348): stdout: | (launched: 2022-12-09_20:56:38.732265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:40.218093 run osmo-stp_10.42.42.5(pid=14348): stderr: | 20221209205638899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205638899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205638899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205638900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205638900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205638900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205638900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:40.347590 run osmo-stp_10.42.42.5(pid=14348): stdout: | (launched: 2022-12-09_20:56:38.732265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:40.471798 run osmo-stp_10.42.42.5(pid=14348): stderr: | 20221209205638899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205638899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205638899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205638900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205638900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205638900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205638900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:40.618764 run patchelf(pid=14351): Terminating (SIGINT) 20:56:40.788793 run patchelf(pid=14351): Terminated: ok {rc=0} 20:56:40.911590 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14348): Process ended prematurely: osmo-stp_10.42.42.5(pid=14348) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14348)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 20:56:40.921147 tst iperf3m4.py:8: Test FAILED (10.5 sec) 20:56:40.949292 run osmo-hlr_10.42.42.2(pid=14345): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14345)] 20:56:40.996904 run osmo-hlr_10.42.42.2(pid=14345): stdout: | (launched: 2022-12-09_20:56:37.797139) 20:56:41.046220 run osmo-hlr_10.42.42.2(pid=14345): stderr: | 20221209205637968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205637968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205637968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205637969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205637969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205637969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205637981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205637989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205637989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205637989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:41.095991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14334): Terminating (SIGTERM) 20:56:41.135546 run iperf3-srv_10.42.42.10(pid=14335): Terminating (SIGTERM) 20:56:41.175302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14336): Terminating (SIGTERM) 20:56:41.214797 run iperf3-srv_10.42.42.10(pid=14337): Terminating (SIGTERM) 20:56:41.254061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14338): Terminating (SIGTERM) 20:56:41.293367 run iperf3-srv_10.42.42.10(pid=14339): Terminating (SIGTERM) 20:56:41.333149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14340): Terminating (SIGTERM) 20:56:41.372455 run iperf3-srv_10.42.42.10(pid=14341): Terminating (SIGTERM) 20:56:41.411512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14344): Terminating (SIGTERM) 20:56:41.450717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14347): Terminating (SIGTERM) 20:56:41.490084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14350): Terminating (SIGTERM) 20:56:41.529717 --- ParallelTerminationStrategy: PID 14334 died... 20:56:41.548477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14334): Terminated: ok {rc=0} 20:56:41.592637 --- ParallelTerminationStrategy: PID 14335 died... 20:56:41.611017 run iperf3-srv_10.42.42.10(pid=14335): Terminated {rc=256} 20:56:41.654545 --- ParallelTerminationStrategy: PID 14336 died... 20:56:41.672997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14336): Terminated: ok {rc=0} 20:56:41.717145 --- ParallelTerminationStrategy: PID 14337 died... 20:56:41.735587 run iperf3-srv_10.42.42.10(pid=14337): Terminated {rc=256} 20:56:41.779325 --- ParallelTerminationStrategy: PID 14338 died... 20:56:41.797736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14338): Terminated: ok {rc=0} 20:56:41.841606 --- ParallelTerminationStrategy: PID 14339 died... 20:56:41.859978 run iperf3-srv_10.42.42.10(pid=14339): Terminated {rc=256} 20:56:41.903865 --- ParallelTerminationStrategy: PID 14340 died... 20:56:41.922731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14340): Terminated: ok {rc=0} 20:56:41.967030 --- ParallelTerminationStrategy: PID 14341 died... 20:56:41.985624 run iperf3-srv_10.42.42.10(pid=14341): Terminated {rc=256} 20:56:42.029321 --- ParallelTerminationStrategy: PID 14344 died... 20:56:42.047734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14344): Terminated: ok {rc=0} 20:56:42.091762 --- ParallelTerminationStrategy: PID 14347 died... 20:56:42.110384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14347): Terminated: ok {rc=0} 20:56:42.154349 --- ParallelTerminationStrategy: PID 14350 died... 20:56:42.172813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14350): Terminated: ok {rc=0} 20:56:42.255944 bus /gobi_4: Setting Powered False 20:56:43.354857 bus /gobi_4: Setting Powered False 20:56:44.473089 bus /gobi_1: Setting Powered False 20:56:45.572446 bus /gobi_1: Setting Powered False 20:56:46.695383 bus /gobi_0: Setting Powered False 20:56:47.795670 bus /gobi_0: Setting Powered False 20:56:48.913629 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 20:56:50.016493 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.028236 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:50.103477 tst ping.py: using LAC 23672 20:56:50.221229 tst ping.py: using RAC 212 20:56:50.336708 tst ping.py: using CellId 23672 20:56:50.452671 tst ping.py: using BVCI 23673 20:56:50.560709 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.571658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.582378 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.593275 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.604274 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.615215 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.626284 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:50.637453 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:50.755966 tst ping.py:19: start network... 20:56:50.972254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:51.468205 run create_hlr_db(pid=14352): Launched 20:56:51.600002 bus /gobi_6: Setting Powered False 20:56:52.662884 run create_hlr_db(pid=14352): Terminated: ok {rc=0} 20:56:53.091879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14354): Launched 20:56:53.392745 run osmo-hlr_10.42.42.2(pid=14355): Launched 20:56:53.506865 run osmo-stp_10.42.42.5: Starting osmo-stp 20:56:54.037762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14357): Launched 20:56:54.336334 run osmo-stp_10.42.42.5(pid=14358): Launched 20:56:54.449978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:56:54.966622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14360): Launched 20:56:55.080784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:56:55.334286 run patchelf(pid=14361): Launched 20:56:55.499667 run osmo-stp_10.42.42.5(pid=14358): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14358)] 20:56:55.625899 run osmo-stp_10.42.42.5(pid=14358): stdout: | (launched: 2022-12-09_20:56:54.280831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:55.753999 run osmo-stp_10.42.42.5(pid=14358): stderr: | 20221209205654452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205654453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205654453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205654453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205654454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205654454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205654454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:55.882905 run osmo-stp_10.42.42.5(pid=14358): stdout: | (launched: 2022-12-09_20:56:54.280831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:56:56.005571 run osmo-stp_10.42.42.5(pid=14358): stderr: | 20221209205654452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205654453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205654453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205654453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205654454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205654454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205654454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:56:56.150457 run patchelf(pid=14361): Terminating (SIGINT) 20:56:56.318320 run patchelf(pid=14361): Terminated: ok {rc=0} 20:56:56.439511 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14358): Process ended prematurely: osmo-stp_10.42.42.5(pid=14358) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14358)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 20:56:56.448670 tst ping.py:22: Test FAILED (6.4 sec) 20:56:56.476391 run osmo-hlr_10.42.42.2(pid=14355): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14355)] 20:56:56.524199 run osmo-hlr_10.42.42.2(pid=14355): stdout: | (launched: 2022-12-09_20:56:53.336783) 20:56:56.573669 run osmo-hlr_10.42.42.2(pid=14355): stderr: | 20221209205653513 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205653513 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205653513 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205653513 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205653513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205653513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205653525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205653535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205653535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205653535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:56:56.623800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14354): Terminating (SIGTERM) 20:56:56.664053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14357): Terminating (SIGTERM) 20:56:56.703954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14360): Terminating (SIGTERM) 20:56:56.744215 --- ParallelTerminationStrategy: PID 14354 died... 20:56:56.763415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14354): Terminated: ok {rc=0} 20:56:56.807758 --- ParallelTerminationStrategy: PID 14357 died... 20:56:56.826395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14357): Terminated: ok {rc=0} 20:56:56.870704 --- ParallelTerminationStrategy: PID 14360 died... 20:56:56.889334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14360): Terminated: ok {rc=0} 20:56:56.975317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 20:56:58.064585 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.076619 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 20:56:58.148211 tst ping_idle_ping.py: using LAC 23673 20:56:58.274546 tst ping_idle_ping.py: using RAC 213 20:56:58.401505 tst ping_idle_ping.py: using CellId 23673 20:56:58.528699 tst ping_idle_ping.py: using BVCI 23674 20:56:58.645644 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.657178 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.668475 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.680443 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.692331 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.705074 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.716507 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 20:56:58.728336 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 20:56:58.845951 tst ping_idle_ping.py:24: start network... 20:56:59.047387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:56:59.515017 run create_hlr_db(pid=14362): Launched 20:56:59.630869 bus /gobi_6: Setting Powered False 20:57:00.691284 run create_hlr_db(pid=14362): Terminated: ok {rc=0} 20:57:01.154876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14364): Launched 20:57:01.496124 run osmo-hlr_10.42.42.2(pid=14365): Launched 20:57:01.750181 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:02.472619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14367): Launched 20:57:02.770849 run osmo-stp_10.42.42.5(pid=14368): Launched 20:57:02.883984 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:57:03.399736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14370): Launched 20:57:03.513687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:57:03.767194 run patchelf(pid=14371): Launched 20:57:03.933095 run osmo-stp_10.42.42.5(pid=14368): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14368)] 20:57:04.059885 run osmo-stp_10.42.42.5(pid=14368): stdout: | (launched: 2022-12-09_20:57:02.715898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:04.188159 run osmo-stp_10.42.42.5(pid=14368): stderr: | 20221209205702887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205702888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205702888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205702888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205702889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205702889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205702889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:04.316500 run osmo-stp_10.42.42.5(pid=14368): stdout: | (launched: 2022-12-09_20:57:02.715898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:04.439333 run osmo-stp_10.42.42.5(pid=14368): stderr: | 20221209205702887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205702888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205702888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205702888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205702889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205702889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205702889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:04.584338 run patchelf(pid=14371): Terminating (SIGINT) 20:57:04.752253 run patchelf(pid=14371): Terminated: ok {rc=0} 20:57:04.873379 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14368): Process ended prematurely: osmo-stp_10.42.42.5(pid=14368) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14368)] [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 20:57:04.882508 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 20:57:04.910228 run osmo-hlr_10.42.42.2(pid=14365): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14365)] 20:57:04.958593 run osmo-hlr_10.42.42.2(pid=14365): stdout: | (launched: 2022-12-09_20:57:01.435404) 20:57:05.008549 run osmo-hlr_10.42.42.2(pid=14365): stderr: | 20221209205701688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205701688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205701688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205701688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205701688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205701688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205701704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205701721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205701721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205701721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:05.058720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14364): Terminating (SIGTERM) 20:57:05.098958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14367): Terminating (SIGTERM) 20:57:05.139215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14370): Terminating (SIGTERM) 20:57:05.179876 --- ParallelTerminationStrategy: PID 14364 died... 20:57:05.199062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14364): Terminated: ok {rc=0} 20:57:05.243654 --- ParallelTerminationStrategy: PID 14367 died... 20:57:05.262134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14367): Terminated: ok {rc=0} 20:57:05.306466 --- ParallelTerminationStrategy: PID 14370 died... 20:57:05.324856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14370): Terminated: ok {rc=0} 20:57:05.408355 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:57:06.717914 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:06.726728 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:57:06.761873 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 20:57:06.797986 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:57:06.851069 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:57:06.885127 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 20:57:06.920737 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:57:07.476187 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 20:57:07.482112 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:07.493395 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:57:07.563335 tst switch_tch_pdch.py: using LAC 23674 20:57:07.679084 tst switch_tch_pdch.py: using RAC 214 20:57:07.794774 tst switch_tch_pdch.py: using CellId 23674 20:57:07.910184 tst switch_tch_pdch.py: using BVCI 23675 20:57:08.020758 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.031864 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.042772 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.054111 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.065581 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.076724 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.088140 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 20:57:08.099613 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:08.217706 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:57:08.346523 tst switch_tch_pdch.py:51: start network... 20:57:08.547565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:09.008382 run create_hlr_db(pid=14375): Launched 20:57:09.121799 bus /gobi_6: Setting Powered False 20:57:10.181307 run create_hlr_db(pid=14375): Terminated: ok {rc=0} 20:57:10.619265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14377): Launched 20:57:10.939021 run osmo-hlr_10.42.42.2(pid=14378): Launched 20:57:11.064104 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:11.612498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14380): Launched 20:57:11.932579 run osmo-stp_10.42.42.5(pid=14381): Launched 20:57:12.054141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:57:12.605783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14383): Launched 20:57:12.727101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:57:12.997346 run patchelf(pid=14384): Launched 20:57:13.175796 run osmo-stp_10.42.42.5(pid=14381): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14381)] 20:57:13.310321 run osmo-stp_10.42.42.5(pid=14381): stdout: | (launched: 2022-12-09_20:57:11.873881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:13.446678 run osmo-stp_10.42.42.5(pid=14381): stderr: | 20221209205712065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205712066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205712066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205712066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205712067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205712067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205712067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:13.583162 run osmo-stp_10.42.42.5(pid=14381): stdout: | (launched: 2022-12-09_20:57:11.873881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:13.713375 run osmo-stp_10.42.42.5(pid=14381): stderr: | 20221209205712065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205712066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205712066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205712066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205712067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205712067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205712067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:13.869318 run patchelf(pid=14384): Terminating (SIGINT) 20:57:14.047585 run patchelf(pid=14384): Terminated: ok {rc=0} 20:57:14.176288 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14381): Process ended prematurely: osmo-stp_10.42.42.5(pid=14381) [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14381)] [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 20:57:14.186110 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 20:57:14.214078 run osmo-hlr_10.42.42.2(pid=14378): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14378)] 20:57:14.263679 run osmo-hlr_10.42.42.2(pid=14378): stdout: | (launched: 2022-12-09_20:57:10.880560) 20:57:14.314993 run osmo-hlr_10.42.42.2(pid=14378): stderr: | 20221209205711078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205711078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205711078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205711078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205711078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205711078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205711091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205711101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205711101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205711101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:14.366693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14377): Terminating (SIGTERM) 20:57:14.408141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14380): Terminating (SIGTERM) 20:57:14.449682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14383): Terminating (SIGTERM) 20:57:14.491207 --- ParallelTerminationStrategy: PID 14377 died... 20:57:14.510840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14377): Terminated: ok {rc=0} 20:57:14.556681 --- ParallelTerminationStrategy: PID 14380 died... 20:57:14.576076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14380): Terminated: ok {rc=0} 20:57:14.621920 --- ParallelTerminationStrategy: PID 14383 died... 20:57:14.641416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14383): Terminated: ok {rc=0} 20:57:14.727885 bus /gobi_0: Setting Powered False 20:57:15.824616 bus /gobi_0: Setting Powered False 20:57:16.952507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 20:57:18.209829 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:18.215590 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 20:57:18.249175 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 20:57:18.283682 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 20:57:18.335912 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 20:57:18.368900 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 20:57:18.403367 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 20:57:18.957061 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 20:57:18.962353 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:18.973396 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 20:57:19.042158 tst switch_tch_pdch.py: using LAC 23675 20:57:19.159556 tst switch_tch_pdch.py: using RAC 215 20:57:19.278347 tst switch_tch_pdch.py: using CellId 23675 20:57:19.399479 tst switch_tch_pdch.py: using BVCI 23676 20:57:19.509579 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.520407 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.531117 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.542322 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.553551 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.564770 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.575944 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 20:57:19.587179 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:57:19.703583 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 20:57:19.824613 tst switch_tch_pdch.py:51: start network... 20:57:20.040405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:20.506408 run create_hlr_db(pid=14388): Launched 20:57:20.635608 bus /gobi_6: Setting Powered False 20:57:21.698632 run create_hlr_db(pid=14388): Terminated: ok {rc=0} 20:57:22.099622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14390): Launched 20:57:22.397142 run osmo-hlr_10.42.42.2(pid=14391): Launched 20:57:22.510749 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:23.000738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14393): Launched 20:57:23.298606 run osmo-stp_10.42.42.5(pid=14394): Launched 20:57:23.412709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 20:57:23.902138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14396): Launched 20:57:24.015308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 20:57:24.267781 run patchelf(pid=14397): Launched 20:57:24.432646 run osmo-stp_10.42.42.5(pid=14394): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14394)] 20:57:24.558810 run osmo-stp_10.42.42.5(pid=14394): stdout: | (launched: 2022-12-09_20:57:23.243313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:24.686495 run osmo-stp_10.42.42.5(pid=14394): stderr: | 20221209205723415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205723415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205723415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205723416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205723416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205723416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205723416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:24.814508 run osmo-stp_10.42.42.5(pid=14394): stdout: | (launched: 2022-12-09_20:57:23.243313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:24.936419 run osmo-stp_10.42.42.5(pid=14394): stderr: | 20221209205723415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205723415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205723415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205723416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205723416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205723416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205723416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:25.081072 run patchelf(pid=14397): Terminating (SIGINT) 20:57:25.249094 run patchelf(pid=14397): Terminated: ok {rc=0} 20:57:25.370319 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14394): Process ended prematurely: osmo-stp_10.42.42.5(pid=14394) [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14394)] [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 20:57:25.379245 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 20:57:25.406161 run osmo-hlr_10.42.42.2(pid=14391): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14391)] 20:57:25.453752 run osmo-hlr_10.42.42.2(pid=14391): stdout: | (launched: 2022-12-09_20:57:22.342123) 20:57:25.502656 run osmo-hlr_10.42.42.2(pid=14391): stderr: | 20221209205722517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205722517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205722517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205722517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205722517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205722517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205722529 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205722538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205722539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205722539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:25.552047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14390): Terminating (SIGTERM) 20:57:25.591715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14393): Terminating (SIGTERM) 20:57:25.631100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14396): Terminating (SIGTERM) 20:57:25.670719 --- ParallelTerminationStrategy: PID 14390 died... 20:57:25.689533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14390): Terminated: ok {rc=0} 20:57:25.734089 --- ParallelTerminationStrategy: PID 14393 died... 20:57:25.752505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14393): Terminated: ok {rc=0} 20:57:25.796798 --- ParallelTerminationStrategy: PID 14396 died... 20:57:25.815918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14396): Terminated: ok {rc=0} 20:57:25.903098 bus /gobi_0: Setting Powered False 20:57:27.004277 bus /gobi_0: Setting Powered False 20:57:28.118129 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:29.368864 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:29.373184 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:29.403140 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:57:29.410136 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:57:29.462263 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:29.491819 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:57:29.498796 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:57:30.038667 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:57:30.043787 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:57:30.055016 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:30.098621 tst mo_mt_sms.py: using LAC 23676 20:57:30.225406 tst mo_mt_sms.py: using RAC 216 20:57:30.349476 tst mo_mt_sms.py: using CellId 23676 20:57:30.470756 tst mo_mt_sms.py: using BVCI 23677 20:57:30.581220 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:30.697351 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:30.813084 tst mo_mt_sms.py:9: start nitb and bts... 20:57:31.035577 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:57:31.667680 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14403): Launched 20:57:32.004185 run osmo-nitb_10.42.42.2(pid=14404): Launched 20:57:32.217650 run osmo-nitb_10.42.42.2(pid=14404): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14404)] 20:57:32.360889 run osmo-nitb_10.42.42.2(pid=14404): stdout: | (launched: 2022-12-09_20:57:31.945721) 20:57:32.505595 run osmo-nitb_10.42.42.2(pid=14404): stderr: | (launched: 2022-12-09_20:57:31.994373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:32.650323 run osmo-nitb_10.42.42.2(pid=14404): stdout: | (launched: 2022-12-09_20:57:31.945721) 20:57:32.789191 run osmo-nitb_10.42.42.2(pid=14404): stderr: | (launched: 2022-12-09_20:57:31.994373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14404): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14404) [trial-2364↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14404)] 20:57:33.160425 tst osmo-nitb_10.42.42.2(pid=14404): stdout: | (launched: 2022-12-09_20:57:31.945721) 20:57:33.289114 tst osmo-nitb_10.42.42.2(pid=14404): stderr: | (launched: 2022-12-09_20:57:31.994373) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:33.441570 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14404): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14404) [trial-2364↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14404)] [trial-2364↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 20:57:33.450775 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 20:57:33.457971 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14403): Terminating (SIGTERM) 20:57:33.668426 --- ParallelTerminationStrategy: PID 14403 died... 20:57:33.689984 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14403): Terminated: ok {rc=0} 20:57:33.778334 bus /sierra_3: Setting Powered False 20:57:34.878869 bus /sierra_3: Setting Powered False 20:57:35.997625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:37.195013 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:37.199745 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:37.229630 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:57:37.256062 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:57:37.306910 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:37.336516 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:57:37.364289 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:57:37.914375 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 20:57:37.919944 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:37.931454 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:37.976072 tst mo_mt_sms.py: using LAC 23677 20:57:38.100904 tst mo_mt_sms.py: using RAC 217 20:57:38.223608 tst mo_mt_sms.py: using CellId 23677 20:57:38.346308 tst mo_mt_sms.py: using BVCI 23678 20:57:38.461813 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:38.472931 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:38.484003 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:38.495177 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:38.506369 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:38.517585 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:38.632240 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:57:38.751842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:39.214351 run create_hlr_db(pid=14409): Launched 20:57:39.328626 bus /sierra_2: Setting Powered False 20:57:40.388470 run create_hlr_db(pid=14409): Terminated: ok {rc=0} 20:57:40.803724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Launched 20:57:41.101177 run osmo-hlr_10.42.42.2(pid=14412): Launched 20:57:41.214580 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:41.740177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Launched 20:57:42.038858 run osmo-stp_10.42.42.5(pid=14415): Launched 20:57:42.152830 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:42.696255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Launched 20:57:42.995875 run osmo-msc_10.42.42.6(pid=14418): Launched 20:57:43.163189 run osmo-stp_10.42.42.5(pid=14415): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] 20:57:43.289999 run osmo-stp_10.42.42.5(pid=14415): stdout: | (launched: 2022-12-09_20:57:41.983749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:43.417228 run osmo-stp_10.42.42.5(pid=14415): stderr: | 20221209205742154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205742154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205742154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205742155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205742155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205742155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205742155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:43.542073 run osmo-stp_10.42.42.5(pid=14415): stdout: | (launched: 2022-12-09_20:57:41.983749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:43.661085 run osmo-stp_10.42.42.5(pid=14415): stderr: | 20221209205742154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205742154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205742154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205742155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205742155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205742155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205742155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:43.803316 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14415): Process ended prematurely: osmo-stp_10.42.42.5(pid=14415) [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 20:57:43.811705 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 20:57:43.838295 run osmo-hlr_10.42.42.2(pid=14412): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14412)] 20:57:43.886087 run osmo-hlr_10.42.42.2(pid=14412): stdout: | (launched: 2022-12-09_20:57:41.046034) 20:57:43.935362 run osmo-hlr_10.42.42.2(pid=14412): stderr: | 20221209205741222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205741222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205741222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205741222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205741222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205741222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205741233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205741242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205741242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205741242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:44.005155 run osmo-msc_10.42.42.6(pid=14418): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14418)] 20:57:44.053189 run osmo-msc_10.42.42.6(pid=14418): stdout: | (launched: 2022-12-09_20:57:42.939746) 20:57:44.102578 run osmo-msc_10.42.42.6(pid=14418): stderr: | 20221209205743209 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205743209 DLGLOBAL DEBUG validating counter group 0x7fd80c5ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205743209 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205743209 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205743209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205743209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205743211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205743212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205743212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205743212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:57:44.152303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Terminating (SIGTERM) 20:57:44.192015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Terminating (SIGTERM) 20:57:44.231659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Terminating (SIGTERM) 20:57:44.271921 --- ParallelTerminationStrategy: PID 14411 died... 20:57:44.291084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14411): Terminated: ok {rc=0} 20:57:44.335411 --- ParallelTerminationStrategy: PID 14414 died... 20:57:44.353992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14414): Terminated: ok {rc=0} 20:57:44.398286 --- ParallelTerminationStrategy: PID 14417 died... 20:57:44.416800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14417): Terminated: ok {rc=0} 20:57:44.503261 bus /sierra_3: Setting Powered False 20:57:45.601927 bus /sierra_3: Setting Powered False 20:57:46.723849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:47.948394 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:47.952690 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:47.982476 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 20:57:47.989665 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:57:48.025060 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:48.055191 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 20:57:48.062197 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:57:48.582949 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:57:48.588011 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 20:57:48.599370 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:48.643195 tst assert_extension.py: using LAC 23678 20:57:48.771555 tst assert_extension.py: using RAC 218 20:57:48.888816 tst assert_extension.py: using CellId 23678 20:57:49.007652 tst assert_extension.py: using BVCI 23679 20:57:49.118727 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:57:49.236461 tst assert_extension.py:10: start nitb and bts... 20:57:49.451460 run osmo-nitb_10.42.42.2: Starting osmo-nitb 20:57:50.104500 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14423): Launched 20:57:50.424553 run osmo-nitb_10.42.42.2(pid=14424): Launched 20:57:50.601474 run osmo-nitb_10.42.42.2(pid=14424): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14424)] 20:57:50.744345 run osmo-nitb_10.42.42.2(pid=14424): stdout: | (launched: 2022-12-09_20:57:50.365815) 20:57:50.889234 run osmo-nitb_10.42.42.2(pid=14424): stderr: | (launched: 2022-12-09_20:57:50.413515) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:51.033443 run osmo-nitb_10.42.42.2(pid=14424): stdout: | (launched: 2022-12-09_20:57:50.365815) 20:57:51.172312 run osmo-nitb_10.42.42.2(pid=14424): stderr: | (launched: 2022-12-09_20:57:50.413515) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14424) [trial-2364↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14424)] 20:57:51.544883 tst osmo-nitb_10.42.42.2(pid=14424): stdout: | (launched: 2022-12-09_20:57:50.365815) 20:57:51.674331 tst osmo-nitb_10.42.42.2(pid=14424): stderr: | (launched: 2022-12-09_20:57:50.413515) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 20:57:51.827146 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14424) [trial-2364↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14424)] [trial-2364↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 20:57:51.836249 tst assert_extension.py:12: Test FAILED (3.2 sec) 20:57:51.843513 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14423): Terminating (SIGTERM) 20:57:52.055323 --- ParallelTerminationStrategy: PID 14423 died... 20:57:52.077280 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14423): Terminated: ok {rc=0} 20:57:52.166755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 20:57:53.338164 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:57:53.343336 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 20:57:53.373426 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:57:53.400764 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 20:57:53.436902 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 20:57:53.466261 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:57:53.492937 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 20:57:54.024348 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 20:57:54.029837 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.041148 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 20:57:54.085371 tst assert_extension.py: using LAC 23679 20:57:54.210482 tst assert_extension.py: using RAC 219 20:57:54.335969 tst assert_extension.py: using CellId 23679 20:57:54.460286 tst assert_extension.py: using BVCI 23680 20:57:54.575410 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.586639 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.597746 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.608636 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.619670 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:57:54.630795 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 20:57:54.745244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:57:55.207921 run create_hlr_db(pid=14430): Launched 20:57:55.323769 bus /sierra_2: Setting Powered False 20:57:56.384062 run create_hlr_db(pid=14430): Terminated: ok {rc=0} 20:57:56.801139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Launched 20:57:57.099710 run osmo-hlr_10.42.42.2(pid=14433): Launched 20:57:57.214176 run osmo-stp_10.42.42.5: Starting osmo-stp 20:57:57.730087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Launched 20:57:58.029026 run osmo-stp_10.42.42.5(pid=14436): Launched 20:57:58.143042 run osmo-msc_10.42.42.6: Starting osmo-msc 20:57:58.681712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Launched 20:57:58.979926 run osmo-msc_10.42.42.6(pid=14439): Launched 20:57:59.146660 run osmo-stp_10.42.42.5(pid=14436): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] 20:57:59.272886 run osmo-stp_10.42.42.5(pid=14436): stdout: | (launched: 2022-12-09_20:57:57.973150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:59.399879 run osmo-stp_10.42.42.5(pid=14436): stderr: | 20221209205758144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205758144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205758144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205758144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205758145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205758145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205758145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:59.523844 run osmo-stp_10.42.42.5(pid=14436): stdout: | (launched: 2022-12-09_20:57:57.973150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:57:59.642364 run osmo-stp_10.42.42.5(pid=14436): stderr: | 20221209205758144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205758144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205758144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205758144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205758145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205758145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205758145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:57:59.784057 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14436): Process ended prematurely: osmo-stp_10.42.42.5(pid=14436) [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 20:57:59.792416 tst assert_extension.py:17: Test FAILED (5.8 sec) 20:57:59.819094 run osmo-hlr_10.42.42.2(pid=14433): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14433)] 20:57:59.866197 run osmo-hlr_10.42.42.2(pid=14433): stdout: | (launched: 2022-12-09_20:57:57.044652) 20:57:59.914920 run osmo-hlr_10.42.42.2(pid=14433): stderr: | 20221209205757220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205757220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205757220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205757221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205757221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205757221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205757232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205757241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205757241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205757241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:57:59.983139 run osmo-msc_10.42.42.6(pid=14439): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14439)] 20:58:00.030256 run osmo-msc_10.42.42.6(pid=14439): stdout: | (launched: 2022-12-09_20:57:58.924928) 20:58:00.079155 run osmo-msc_10.42.42.6(pid=14439): stderr: | 20221209205759197 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205759197 DLGLOBAL DEBUG validating counter group 0x7f6b426acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205759197 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205759197 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205759198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205759198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205759200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205759201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205759201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205759201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:00.128593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Terminating (SIGTERM) 20:58:00.167812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Terminating (SIGTERM) 20:58:00.206931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Terminating (SIGTERM) 20:58:00.246411 --- ParallelTerminationStrategy: PID 14432 died... 20:58:00.265324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Terminated: ok {rc=0} 20:58:00.309212 --- ParallelTerminationStrategy: PID 14435 died... 20:58:00.327591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Terminated: ok {rc=0} 20:58:00.371185 --- ParallelTerminationStrategy: PID 14438 died... 20:58:00.389489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Terminated: ok {rc=0} 20:58:00.472465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 20:58:01.705278 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:01.712749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 20:58:01.744705 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 20:58:01.773401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 20:58:01.826834 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 20:58:01.862665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 20:58:01.891391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 20:58:02.437815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 20:58:02.491472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:02.503441 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:58:02.571489 tst mo_mt_call.py: using LAC 23680 20:58:02.704633 tst mo_mt_call.py: using RAC 220 20:58:02.824874 tst mo_mt_call.py: using CellId 23680 20:58:02.942525 tst mo_mt_call.py: using BVCI 23681 20:58:03.055498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:03.066937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:03.078215 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:03.089621 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:03.100923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:03.112627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:58:03.231962 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:58:03.353864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:03.826132 run create_hlr_db(pid=14444): Launched 20:58:03.942921 bus /sierra_2: Setting Powered False 20:58:05.003177 run create_hlr_db(pid=14444): Terminated: ok {rc=0} 20:58:05.427049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Launched 20:58:05.730859 run osmo-hlr_10.42.42.2(pid=14447): Launched 20:58:05.847070 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:06.375825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Launched 20:58:06.681251 run osmo-stp_10.42.42.5(pid=14450): Launched 20:58:06.797166 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:07.347539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Launched 20:58:07.651452 run osmo-msc_10.42.42.6(pid=14453): Launched 20:58:07.820846 run osmo-stp_10.42.42.5(pid=14450): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] 20:58:07.950349 run osmo-stp_10.42.42.5(pid=14450): stdout: | (launched: 2022-12-09_20:58:06.624804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:08.079623 run osmo-stp_10.42.42.5(pid=14450): stderr: | 20221209205806797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205806797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205806797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205806797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205806798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205806798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205806798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:08.206542 run osmo-stp_10.42.42.5(pid=14450): stdout: | (launched: 2022-12-09_20:58:06.624804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:08.327770 run osmo-stp_10.42.42.5(pid=14450): stderr: | 20221209205806797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205806797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205806797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205806797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205806798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205806798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205806798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:08.472500 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14450): Process ended prematurely: osmo-stp_10.42.42.5(pid=14450) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 20:58:08.481544 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 20:58:08.508550 run osmo-hlr_10.42.42.2(pid=14447): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14447)] 20:58:08.556222 run osmo-hlr_10.42.42.2(pid=14447): stdout: | (launched: 2022-12-09_20:58:05.675112) 20:58:08.605284 run osmo-hlr_10.42.42.2(pid=14447): stderr: | 20221209205805852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205805852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205805852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205805852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205805852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205805852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205805863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205805872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205805873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205805873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:08.674267 run osmo-msc_10.42.42.6(pid=14453): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14453)] 20:58:08.721545 run osmo-msc_10.42.42.6(pid=14453): stdout: | (launched: 2022-12-09_20:58:07.594882) 20:58:08.770354 run osmo-msc_10.42.42.6(pid=14453): stderr: | 20221209205807868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205807869 DLGLOBAL DEBUG validating counter group 0x7fbe81674c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205807869 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205807869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205807869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205807869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205807873 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205807874 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205807874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205807874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:08.819588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Terminating (SIGTERM) 20:58:08.858763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Terminating (SIGTERM) 20:58:08.897978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Terminating (SIGTERM) 20:58:08.937728 --- ParallelTerminationStrategy: PID 14446 died... 20:58:08.956707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14446): Terminated: ok {rc=0} 20:58:09.000824 --- ParallelTerminationStrategy: PID 14449 died... 20:58:09.019820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14449): Terminated: ok {rc=0} 20:58:09.063786 --- ParallelTerminationStrategy: PID 14452 died... 20:58:09.082332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14452): Terminated: ok {rc=0} 20:58:09.167638 bus /sierra_3: Setting Powered False 20:58:10.267784 bus /sierra_3: Setting Powered False 20:58:11.382606 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 20:58:12.528413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:12.540393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 20:58:12.614970 tst mo_mt_call_osmux.py: using LAC 23681 20:58:12.735061 tst mo_mt_call_osmux.py: using RAC 221 20:58:12.855451 tst mo_mt_call_osmux.py: using CellId 23681 20:58:12.983569 tst mo_mt_call_osmux.py: using BVCI 23682 20:58:13.095045 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:13.106375 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:13.117476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:13.128828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:13.140261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 20:58:13.151616 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:58:13.270779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 20:58:13.387450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:13.859731 run create_hlr_db(pid=14455): Launched 20:58:13.974971 bus /sierra_2: Setting Powered False 20:58:15.035115 run create_hlr_db(pid=14455): Terminated: ok {rc=0} 20:58:15.481112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14457): Launched 20:58:15.807381 run osmo-hlr_10.42.42.2(pid=14458): Launched 20:58:16.041587 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:16.801730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14460): Launched 20:58:17.114018 run osmo-stp_10.42.42.5(pid=14461): Launched 20:58:17.289537 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:17.886707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14463): Launched 20:58:18.192815 run osmo-msc_10.42.42.6(pid=14464): Launched 20:58:18.364379 run osmo-stp_10.42.42.5(pid=14461): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14461)] 20:58:18.493965 run osmo-stp_10.42.42.5(pid=14461): stdout: | (launched: 2022-12-09_20:58:17.057694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:18.623541 run osmo-stp_10.42.42.5(pid=14461): stderr: | 20221209205817440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205817440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205817441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205817441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205817441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205817441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205817442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:18.750385 run osmo-stp_10.42.42.5(pid=14461): stdout: | (launched: 2022-12-09_20:58:17.057694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:18.871884 run osmo-stp_10.42.42.5(pid=14461): stderr: | 20221209205817440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205817440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205817441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205817441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205817441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205817441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205817442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:19.017134 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14461): Process ended prematurely: osmo-stp_10.42.42.5(pid=14461) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14461)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 20:58:19.026190 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 20:58:19.053307 run osmo-hlr_10.42.42.2(pid=14458): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14458)] 20:58:19.101177 run osmo-hlr_10.42.42.2(pid=14458): stdout: | (launched: 2022-12-09_20:58:15.747665) 20:58:19.150508 run osmo-hlr_10.42.42.2(pid=14458): stderr: | 20221209205816028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205816028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205816028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205816028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205816028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205816028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205816047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205816064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205816064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205816064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:19.219533 run osmo-msc_10.42.42.6(pid=14464): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14464)] 20:58:19.267156 run osmo-msc_10.42.42.6(pid=14464): stdout: | (launched: 2022-12-09_20:58:18.136580) 20:58:19.316744 run osmo-msc_10.42.42.6(pid=14464): stderr: | 20221209205818410 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205818410 DLGLOBAL DEBUG validating counter group 0x7f320653cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205818410 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205818410 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205818411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205818411 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205818412 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205818413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205818413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205818413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:19.366298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14457): Terminating (SIGTERM) 20:58:19.405841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14460): Terminating (SIGTERM) 20:58:19.445452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14463): Terminating (SIGTERM) 20:58:19.485762 --- ParallelTerminationStrategy: PID 14457 died... 20:58:19.505169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14457): Terminated: ok {rc=0} 20:58:19.549314 --- ParallelTerminationStrategy: PID 14460 died... 20:58:19.567907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14460): Terminated: ok {rc=0} 20:58:19.611833 --- ParallelTerminationStrategy: PID 14463 died... 20:58:19.630429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14463): Terminated: ok {rc=0} 20:58:19.713497 bus /sierra_3: Setting Powered False 20:58:20.811015 bus /sierra_3: Setting Powered False 20:58:21.929873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 20:58:23.180266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:23.187515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 20:58:23.217124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 20:58:23.243540 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 20:58:23.295303 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 20:58:23.324578 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 20:58:23.351175 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 20:58:23.902002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 20:58:23.950906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:23.962168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:58:24.034530 tst mo_mt_call.py: using LAC 23682 20:58:24.153910 tst mo_mt_call.py: using RAC 222 20:58:24.274313 tst mo_mt_call.py: using CellId 23682 20:58:24.394469 tst mo_mt_call.py: using BVCI 23683 20:58:24.507232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:24.518501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:24.529751 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:24.541087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:24.552395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:24.563710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:24.683169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:24.803643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:25.308260 run create_hlr_db(pid=14469): Launched 20:58:25.441629 bus /sierra_2: Setting Powered False 20:58:26.505876 run create_hlr_db(pid=14469): Terminated: ok {rc=0} 20:58:26.940685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14471): Launched 20:58:27.246403 run osmo-hlr_10.42.42.2(pid=14472): Launched 20:58:27.362384 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:27.899549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14474): Launched 20:58:28.203411 run osmo-stp_10.42.42.5(pid=14475): Launched 20:58:28.318706 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:28.868739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14477): Launched 20:58:29.172776 run osmo-msc_10.42.42.6(pid=14478): Launched 20:58:29.342742 run osmo-stp_10.42.42.5(pid=14475): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14475)] 20:58:29.471555 run osmo-stp_10.42.42.5(pid=14475): stdout: | (launched: 2022-12-09_20:58:28.147195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:29.600152 run osmo-stp_10.42.42.5(pid=14475): stderr: | 20221209205828318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205828318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205828318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205828319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205828319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205828319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205828319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:29.726845 run osmo-stp_10.42.42.5(pid=14475): stdout: | (launched: 2022-12-09_20:58:28.147195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:29.847878 run osmo-stp_10.42.42.5(pid=14475): stderr: | 20221209205828318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205828318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205828318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205828319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205828319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205828319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205828319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:29.993358 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14475): Process ended prematurely: osmo-stp_10.42.42.5(pid=14475) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14475)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 20:58:30.002402 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 20:58:30.028893 run osmo-hlr_10.42.42.2(pid=14472): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14472)] 20:58:30.076280 run osmo-hlr_10.42.42.2(pid=14472): stdout: | (launched: 2022-12-09_20:58:27.190218) 20:58:30.125164 run osmo-hlr_10.42.42.2(pid=14472): stderr: | 20221209205827367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205827367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205827367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205827367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205827367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205827367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205827380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205827390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205827390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205827390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:30.193183 run osmo-msc_10.42.42.6(pid=14478): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14478)] 20:58:30.240117 run osmo-msc_10.42.42.6(pid=14478): stdout: | (launched: 2022-12-09_20:58:29.116843) 20:58:30.288725 run osmo-msc_10.42.42.6(pid=14478): stderr: | 20221209205829389 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205829389 DLGLOBAL DEBUG validating counter group 0x7fe18a40cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205829389 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205829389 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205829389 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205829390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205829392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205829393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205829393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205829393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:30.337782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14471): Terminating (SIGTERM) 20:58:30.377327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14474): Terminating (SIGTERM) 20:58:30.416338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14477): Terminating (SIGTERM) 20:58:30.455232 --- ParallelTerminationStrategy: PID 14471 died... 20:58:30.474409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14471): Terminated: ok {rc=0} 20:58:30.517936 --- ParallelTerminationStrategy: PID 14474 died... 20:58:30.536305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14474): Terminated: ok {rc=0} 20:58:30.579897 --- ParallelTerminationStrategy: PID 14477 died... 20:58:30.598292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14477): Terminated: ok {rc=0} 20:58:30.681118 bus /sierra_3: Setting Powered False 20:58:31.784049 bus /sierra_3: Setting Powered False 20:58:32.898594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 20:58:34.046839 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.059353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 20:58:34.127823 tst mo_mt_call_osmux.py: using LAC 23683 20:58:34.256836 tst mo_mt_call_osmux.py: using RAC 223 20:58:34.384760 tst mo_mt_call_osmux.py: using CellId 23683 20:58:34.512760 tst mo_mt_call_osmux.py: using BVCI 23684 20:58:34.630907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.642748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.654340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.665894 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.677609 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 20:58:34.689148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:34.809371 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 20:58:34.930349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:35.436196 run create_hlr_db(pid=14480): Launched 20:58:35.567901 bus /sierra_2: Setting Powered False 20:58:36.632587 run create_hlr_db(pid=14480): Terminated: ok {rc=0} 20:58:37.066114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Launched 20:58:37.371454 run osmo-hlr_10.42.42.2(pid=14483): Launched 20:58:37.487267 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:38.010666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Launched 20:58:38.314517 run osmo-stp_10.42.42.5(pid=14486): Launched 20:58:38.432745 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:38.982735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14488): Launched 20:58:39.287063 run osmo-msc_10.42.42.6(pid=14489): Launched 20:58:39.457747 run osmo-stp_10.42.42.5(pid=14486): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] 20:58:39.586522 run osmo-stp_10.42.42.5(pid=14486): stdout: | (launched: 2022-12-09_20:58:38.258581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:39.715099 run osmo-stp_10.42.42.5(pid=14486): stderr: | 20221209205838429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205838429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205838429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205838430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205838430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205838430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205838430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:39.841390 run osmo-stp_10.42.42.5(pid=14486): stdout: | (launched: 2022-12-09_20:58:38.258581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:39.961987 run osmo-stp_10.42.42.5(pid=14486): stderr: | 20221209205838429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205838429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205838429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205838430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205838430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205838430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205838430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:40.107373 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14486): Process ended prematurely: osmo-stp_10.42.42.5(pid=14486) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 20:58:40.116397 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:58:40.143375 run osmo-hlr_10.42.42.2(pid=14483): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14483)] 20:58:40.190754 run osmo-hlr_10.42.42.2(pid=14483): stdout: | (launched: 2022-12-09_20:58:37.314822) 20:58:40.240183 run osmo-hlr_10.42.42.2(pid=14483): stderr: | 20221209205837491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205837491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205837491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205837491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205837491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205837491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205837503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205837514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205837514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205837514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:40.308661 run osmo-msc_10.42.42.6(pid=14489): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14489)] 20:58:40.355935 run osmo-msc_10.42.42.6(pid=14489): stdout: | (launched: 2022-12-09_20:58:39.230702) 20:58:40.404694 run osmo-msc_10.42.42.6(pid=14489): stderr: | 20221209205839503 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205839503 DLGLOBAL DEBUG validating counter group 0x7f7325260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205839503 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205839503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205839503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205839503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205839505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205839505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205839506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205839506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:40.454236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Terminating (SIGTERM) 20:58:40.493767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Terminating (SIGTERM) 20:58:40.532867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14488): Terminating (SIGTERM) 20:58:40.572283 --- ParallelTerminationStrategy: PID 14482 died... 20:58:40.591251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Terminated: ok {rc=0} 20:58:40.635044 --- ParallelTerminationStrategy: PID 14485 died... 20:58:40.653505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Terminated: ok {rc=0} 20:58:40.697434 --- ParallelTerminationStrategy: PID 14488 died... 20:58:40.715895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14488): Terminated: ok {rc=0} 20:58:40.799275 bus /sierra_3: Setting Powered False 20:58:41.894721 bus /sierra_3: Setting Powered False 20:58:43.005165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 20:58:44.248124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:58:44.254463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 20:58:44.284039 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 20:58:44.310790 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 20:58:44.363440 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 20:58:44.392716 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 20:58:44.419208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 20:58:44.969800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 20:58:45.019068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.030322 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:58:45.094687 tst mo_mt_call.py: using LAC 23684 20:58:45.216674 tst mo_mt_call.py: using RAC 224 20:58:45.336400 tst mo_mt_call.py: using CellId 23684 20:58:45.465016 tst mo_mt_call.py: using BVCI 23685 20:58:45.583954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.595611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.607216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.618942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.630611 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:45.642130 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:45.759073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:45.884193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:46.413541 run create_hlr_db(pid=14494): Launched 20:58:46.610282 bus /sierra_2: Setting Powered False 20:58:47.674473 run create_hlr_db(pid=14494): Terminated: ok {rc=0} 20:58:48.125466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14496): Launched 20:58:48.430771 run osmo-hlr_10.42.42.2(pid=14497): Launched 20:58:48.547601 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:49.072179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14499): Launched 20:58:49.375440 run osmo-stp_10.42.42.5(pid=14500): Launched 20:58:49.491562 run osmo-msc_10.42.42.6: Starting osmo-msc 20:58:50.046512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14502): Launched 20:58:50.352026 run osmo-msc_10.42.42.6(pid=14503): Launched 20:58:50.523641 run osmo-stp_10.42.42.5(pid=14500): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14500)] 20:58:50.653606 run osmo-stp_10.42.42.5(pid=14500): stdout: | (launched: 2022-12-09_20:58:49.319351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:50.783029 run osmo-stp_10.42.42.5(pid=14500): stderr: | 20221209205849489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205849489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205849490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205849490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205849490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205849490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205849491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:50.910335 run osmo-stp_10.42.42.5(pid=14500): stdout: | (launched: 2022-12-09_20:58:49.319351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:58:51.031664 run osmo-stp_10.42.42.5(pid=14500): stderr: | 20221209205849489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205849489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205849490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205849490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205849490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205849490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205849491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:58:51.177105 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14500): Process ended prematurely: osmo-stp_10.42.42.5(pid=14500) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14500)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 20:58:51.186215 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 20:58:51.212813 run osmo-hlr_10.42.42.2(pid=14497): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14497)] 20:58:51.260606 run osmo-hlr_10.42.42.2(pid=14497): stdout: | (launched: 2022-12-09_20:58:48.374043) 20:58:51.309607 run osmo-hlr_10.42.42.2(pid=14497): stderr: | 20221209205848549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205848549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205848549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205848549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205848549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205848549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205848561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205848571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205848571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205848572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:58:51.378488 run osmo-msc_10.42.42.6(pid=14503): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14503)] 20:58:51.426224 run osmo-msc_10.42.42.6(pid=14503): stdout: | (launched: 2022-12-09_20:58:50.295945) 20:58:51.475245 run osmo-msc_10.42.42.6(pid=14503): stderr: | 20221209205850568 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205850569 DLGLOBAL DEBUG validating counter group 0x7fd8fa035c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205850569 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205850569 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205850569 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205850569 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205850571 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205850571 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205850571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205850572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:58:51.524609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14496): Terminating (SIGTERM) 20:58:51.564150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14499): Terminating (SIGTERM) 20:58:51.603885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14502): Terminating (SIGTERM) 20:58:51.643607 --- ParallelTerminationStrategy: PID 14496 died... 20:58:51.662346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14496): Terminated: ok {rc=0} 20:58:51.706262 --- ParallelTerminationStrategy: PID 14499 died... 20:58:51.724725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14499): Terminated: ok {rc=0} 20:58:51.768362 --- ParallelTerminationStrategy: PID 14502 died... 20:58:51.786784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14502): Terminated: ok {rc=0} 20:58:51.871778 bus /sierra_3: Setting Powered False 20:58:52.970827 bus /sierra_3: Setting Powered False 20:58:54.085597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 20:58:55.231463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.243576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 20:58:55.308433 tst mo_mt_call_osmux.py: using LAC 23685 20:58:55.429435 tst mo_mt_call_osmux.py: using RAC 225 20:58:55.557988 tst mo_mt_call_osmux.py: using CellId 23685 20:58:55.678936 tst mo_mt_call_osmux.py: using BVCI 23686 20:58:55.791491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.803040 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.814458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.825941 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.837483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 20:58:55.848544 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:55.970477 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 20:58:56.088195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:58:56.560890 run create_hlr_db(pid=14505): Launched 20:58:56.676500 bus /sierra_2: Setting Powered False 20:58:57.736186 run create_hlr_db(pid=14505): Terminated: ok {rc=0} 20:58:58.181751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14507): Launched 20:58:58.509276 run osmo-hlr_10.42.42.2(pid=14508): Launched 20:58:58.634264 run osmo-stp_10.42.42.5: Starting osmo-stp 20:58:59.194508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14510): Launched 20:58:59.521216 run osmo-stp_10.42.42.5(pid=14511): Launched 20:58:59.647156 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:00.234804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14513): Launched 20:59:00.561322 run osmo-msc_10.42.42.6(pid=14514): Launched 20:59:00.744612 run osmo-stp_10.42.42.5(pid=14511): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14511)] 20:59:00.967960 run osmo-stp_10.42.42.5(pid=14511): stdout: | (launched: 2022-12-09_20:58:59.461741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:01.222582 run osmo-stp_10.42.42.5(pid=14511): stderr: | 20221209205859653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205859653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205859653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205859654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205859654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205859654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205859654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:01.356099 run osmo-stp_10.42.42.5(pid=14511): stdout: | (launched: 2022-12-09_20:58:59.461741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:01.482693 run osmo-stp_10.42.42.5(pid=14511): stderr: | 20221209205859653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205859653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205859653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205859654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205859654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205859654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205859654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:01.634239 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14511): Process ended prematurely: osmo-stp_10.42.42.5(pid=14511) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14511)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 20:59:01.644378 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 20:59:01.675445 run osmo-hlr_10.42.42.2(pid=14508): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14508)] 20:59:01.726410 run osmo-hlr_10.42.42.2(pid=14508): stdout: | (launched: 2022-12-09_20:58:58.448660) 20:59:01.779665 run osmo-hlr_10.42.42.2(pid=14508): stderr: | 20221209205858649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205858649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205858649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205858649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205858649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205858649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205858660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205858669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205858669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205858669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:01.851851 run osmo-msc_10.42.42.6(pid=14514): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14514)] 20:59:01.902271 run osmo-msc_10.42.42.6(pid=14514): stdout: | (launched: 2022-12-09_20:59:00.501583) 20:59:01.954187 run osmo-msc_10.42.42.6(pid=14514): stderr: | 20221209205900824 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205900824 DLGLOBAL DEBUG validating counter group 0x7faaebd3dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205900825 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205900825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205900825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205900826 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205900828 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205900829 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205900829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205900829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:02.008022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14507): Terminating (SIGTERM) 20:59:02.050429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14510): Terminating (SIGTERM) 20:59:02.094503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14513): Terminating (SIGTERM) 20:59:02.139015 --- ParallelTerminationStrategy: PID 14507 died... 20:59:02.159017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14507): Terminated: ok {rc=0} 20:59:02.209083 --- ParallelTerminationStrategy: PID 14510 died... 20:59:02.228813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14510): Terminated: ok {rc=0} 20:59:02.275917 --- ParallelTerminationStrategy: PID 14513 died... 20:59:02.295637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14513): Terminated: ok {rc=0} 20:59:02.384140 bus /sierra_3: Setting Powered False 20:59:03.482123 bus /sierra_3: Setting Powered False 20:59:04.598626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 20:59:05.841236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:05.847516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 20:59:05.876789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 20:59:05.903357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 20:59:05.954447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 20:59:05.983505 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 20:59:06.009841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 20:59:06.561599 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 20:59:06.610508 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:06.621827 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:59:06.686794 tst mo_mt_call.py: using LAC 23686 20:59:06.804937 tst mo_mt_call.py: using RAC 226 20:59:06.923637 tst mo_mt_call.py: using CellId 23686 20:59:07.042267 tst mo_mt_call.py: using BVCI 23687 20:59:07.154243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:07.165535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:07.176839 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:07.188196 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:07.199506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:07.210785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:07.330604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:07.450367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:07.957862 run create_hlr_db(pid=14520): Launched 20:59:08.089915 bus /sierra_2: Setting Powered False 20:59:09.154871 run create_hlr_db(pid=14520): Terminated: ok {rc=0} 20:59:09.609283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Launched 20:59:09.935253 run osmo-hlr_10.42.42.2(pid=14523): Launched 20:59:10.059510 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:10.623627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Launched 20:59:10.949647 run osmo-stp_10.42.42.5(pid=14526): Launched 20:59:11.075109 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:11.663647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14528): Launched 20:59:11.991051 run osmo-msc_10.42.42.6(pid=14529): Launched 20:59:12.174385 run osmo-stp_10.42.42.5(pid=14526): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] 20:59:12.311808 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-09_20:59:10.890107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:12.449500 run osmo-stp_10.42.42.5(pid=14526): stderr: | 20221209205911082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205911082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205911083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205911083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205911083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205911083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205911084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:12.585834 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-09_20:59:10.890107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:12.716092 run osmo-stp_10.42.42.5(pid=14526): stderr: | 20221209205911082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205911082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205911083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205911083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205911083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205911083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205911084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:12.872480 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 20:59:12.882375 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:59:12.910301 run osmo-hlr_10.42.42.2(pid=14523): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14523)] 20:59:12.959895 run osmo-hlr_10.42.42.2(pid=14523): stdout: | (launched: 2022-12-09_20:59:09.875446) 20:59:13.011090 run osmo-hlr_10.42.42.2(pid=14523): stderr: | 20221209205910074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205910074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205910074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205910074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205910074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205910074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205910090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205910098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205910099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205910099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:13.082837 run osmo-msc_10.42.42.6(pid=14529): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14529)] 20:59:13.132136 run osmo-msc_10.42.42.6(pid=14529): stdout: | (launched: 2022-12-09_20:59:11.931553) 20:59:13.183170 run osmo-msc_10.42.42.6(pid=14529): stderr: | 20221209205912253 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205912253 DLGLOBAL DEBUG validating counter group 0x7fa101bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205912253 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205912253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205912253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205912254 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205912255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205912256 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205912256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205912256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:13.234467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminating (SIGTERM) 20:59:13.275605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminating (SIGTERM) 20:59:13.316715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14528): Terminating (SIGTERM) 20:59:13.358353 --- ParallelTerminationStrategy: PID 14522 died... 20:59:13.378382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminated: ok {rc=0} 20:59:13.424064 --- ParallelTerminationStrategy: PID 14525 died... 20:59:13.443674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminated: ok {rc=0} 20:59:13.489093 --- ParallelTerminationStrategy: PID 14528 died... 20:59:13.508549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14528): Terminated: ok {rc=0} 20:59:13.594581 bus /sierra_3: Setting Powered False 20:59:14.691826 bus /sierra_3: Setting Powered False 20:59:15.807360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 20:59:16.982152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:16.998462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 20:59:17.065760 tst mo_mt_call_osmux.py: using LAC 23687 20:59:17.228804 tst mo_mt_call_osmux.py: using RAC 227 20:59:17.354028 tst mo_mt_call_osmux.py: using CellId 23687 20:59:17.476073 tst mo_mt_call_osmux.py: using BVCI 23688 20:59:17.588672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:17.600171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:17.611410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:17.622947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:17.634568 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 20:59:17.646087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:17.762627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 20:59:17.884610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:18.359503 run create_hlr_db(pid=14531): Launched 20:59:18.474853 bus /sierra_2: Setting Powered False 20:59:19.535846 run create_hlr_db(pid=14531): Terminated: ok {rc=0} 20:59:19.960522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Launched 20:59:20.265185 run osmo-hlr_10.42.42.2(pid=14534): Launched 20:59:20.382051 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:20.911079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14536): Launched 20:59:21.215652 run osmo-stp_10.42.42.5(pid=14537): Launched 20:59:21.333132 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:21.883413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14539): Launched 20:59:22.190158 run osmo-msc_10.42.42.6(pid=14540): Launched 20:59:22.359872 run osmo-stp_10.42.42.5(pid=14537): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14537)] 20:59:22.488522 run osmo-stp_10.42.42.5(pid=14537): stdout: | (launched: 2022-12-09_20:59:21.159578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:22.617259 run osmo-stp_10.42.42.5(pid=14537): stderr: | 20221209205921327 DLSS7 [1;32mINFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205921327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205921327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205921328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205921328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205921328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205921328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:22.743583 run osmo-stp_10.42.42.5(pid=14537): stdout: | (launched: 2022-12-09_20:59:21.159578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:22.865113 run osmo-stp_10.42.42.5(pid=14537): stderr: | 20221209205921327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205921327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205921327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205921328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205921328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205921328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205921328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:23.010287 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14537): Process ended prematurely: osmo-stp_10.42.42.5(pid=14537) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14537)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 20:59:23.019209 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 20:59:23.046295 run osmo-hlr_10.42.42.2(pid=14534): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14534)] 20:59:23.093598 run osmo-hlr_10.42.42.2(pid=14534): stdout: | (launched: 2022-12-09_20:59:20.208526) 20:59:23.142713 run osmo-hlr_10.42.42.2(pid=14534): stderr: | 20221209205920384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205920384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205920384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205920384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205920384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205920384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205920396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205920405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205920405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205920405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:23.211430 run osmo-msc_10.42.42.6(pid=14540): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14540)] 20:59:23.258944 run osmo-msc_10.42.42.6(pid=14540): stdout: | (launched: 2022-12-09_20:59:22.133923) 20:59:23.308076 run osmo-msc_10.42.42.6(pid=14540): stderr: | 20221209205922405 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205922405 DLGLOBAL DEBUG validating counter group 0x7fd3027eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205922405 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205922405 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205922406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205922406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205922408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205922408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205922408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205922408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:23.357817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Terminating (SIGTERM) 20:59:23.397688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14536): Terminating (SIGTERM) 20:59:23.437109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14539): Terminating (SIGTERM) 20:59:23.476650 --- ParallelTerminationStrategy: PID 14533 died... 20:59:23.495433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Terminated: ok {rc=0} 20:59:23.539381 --- ParallelTerminationStrategy: PID 14536 died... 20:59:23.557941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14536): Terminated: ok {rc=0} 20:59:23.601600 --- ParallelTerminationStrategy: PID 14539 died... 20:59:23.620096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14539): Terminated: ok {rc=0} 20:59:23.703868 bus /sierra_3: Setting Powered False 20:59:24.803606 bus /sierra_3: Setting Powered False 20:59:25.918078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 20:59:27.160468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:27.166758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 20:59:27.196077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 20:59:27.222496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 20:59:27.274578 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 20:59:27.303879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 20:59:27.330458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 20:59:27.886456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 20:59:27.935233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:27.946398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:59:28.014091 tst mo_mt_call.py: using LAC 23688 20:59:28.134016 tst mo_mt_call.py: using RAC 228 20:59:28.258557 tst mo_mt_call.py: using CellId 23688 20:59:28.377816 tst mo_mt_call.py: using BVCI 23689 20:59:28.488324 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:28.499527 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:28.510636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:28.522098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:28.533475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:28.544524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:28.663712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:28.780131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:29.252474 run create_hlr_db(pid=14545): Launched 20:59:29.367746 bus /sierra_2: Setting Powered False 20:59:30.429502 run create_hlr_db(pid=14545): Terminated: ok {rc=0} 20:59:30.887978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14547): Launched 20:59:31.237082 run osmo-hlr_10.42.42.2(pid=14548): Launched 20:59:31.408392 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:32.106859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14550): Launched 20:59:32.430748 run osmo-stp_10.42.42.5(pid=14551): Launched 20:59:32.547767 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:33.102263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14553): Launched 20:59:33.407570 run osmo-msc_10.42.42.6(pid=14554): Launched 20:59:33.578523 run osmo-stp_10.42.42.5(pid=14551): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14551)] 20:59:33.707601 run osmo-stp_10.42.42.5(pid=14551): stdout: | (launched: 2022-12-09_20:59:32.374683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:33.837200 run osmo-stp_10.42.42.5(pid=14551): stderr: | 20221209205932544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205932544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205932544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205932544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205932545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205932545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205932545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:33.964231 run osmo-stp_10.42.42.5(pid=14551): stdout: | (launched: 2022-12-09_20:59:32.374683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:34.086069 run osmo-stp_10.42.42.5(pid=14551): stderr: | 20221209205932544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205932544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205932544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205932544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205932545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205932545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205932545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:34.231956 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14551): Process ended prematurely: osmo-stp_10.42.42.5(pid=14551) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14551)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 20:59:34.241022 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:59:34.268211 run osmo-hlr_10.42.42.2(pid=14548): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14548)] 20:59:34.316172 run osmo-hlr_10.42.42.2(pid=14548): stdout: | (launched: 2022-12-09_20:59:31.177204) 20:59:34.365837 run osmo-hlr_10.42.42.2(pid=14548): stderr: | 20221209205931536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205931536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205931536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205931537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205931537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205931537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205931555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205931572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205931572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205931572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:34.435187 run osmo-msc_10.42.42.6(pid=14554): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14554)] 20:59:34.483095 run osmo-msc_10.42.42.6(pid=14554): stdout: | (launched: 2022-12-09_20:59:33.351205) 20:59:34.532389 run osmo-msc_10.42.42.6(pid=14554): stderr: | 20221209205933623 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205933623 DLGLOBAL DEBUG validating counter group 0x7f2b57b70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205933623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205933623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205933624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205933624 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205933626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205933626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205933626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205933626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:34.582314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14547): Terminating (SIGTERM) 20:59:34.622171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14550): Terminating (SIGTERM) 20:59:34.661933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14553): Terminating (SIGTERM) 20:59:34.702023 --- ParallelTerminationStrategy: PID 14547 died... 20:59:34.721187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14547): Terminated: ok {rc=0} 20:59:34.765485 --- ParallelTerminationStrategy: PID 14550 died... 20:59:34.783951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14550): Terminated: ok {rc=0} 20:59:34.828441 --- ParallelTerminationStrategy: PID 14553 died... 20:59:34.847203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14553): Terminated: ok {rc=0} 20:59:34.931424 bus /sierra_3: Setting Powered False 20:59:36.029766 bus /sierra_3: Setting Powered False 20:59:37.146157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 20:59:38.292744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.304756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 20:59:38.369831 tst mo_mt_call_osmux.py: using LAC 23689 20:59:38.491387 tst mo_mt_call_osmux.py: using RAC 229 20:59:38.612307 tst mo_mt_call_osmux.py: using CellId 23689 20:59:38.732304 tst mo_mt_call_osmux.py: using BVCI 23690 20:59:38.843147 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.854557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.865672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.876831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.888190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 20:59:38.899711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:39.020564 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 20:59:39.140504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:39.614518 run create_hlr_db(pid=14556): Launched 20:59:39.732302 bus /sierra_2: Setting Powered False 20:59:40.793524 run create_hlr_db(pid=14556): Terminated: ok {rc=0} 20:59:41.219221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14558): Launched 20:59:41.523205 run osmo-hlr_10.42.42.2(pid=14559): Launched 20:59:41.640911 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:42.182447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14561): Launched 20:59:42.487630 run osmo-stp_10.42.42.5(pid=14562): Launched 20:59:42.604753 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:43.157816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14564): Launched 20:59:43.463568 run osmo-msc_10.42.42.6(pid=14565): Launched 20:59:43.634937 run osmo-stp_10.42.42.5(pid=14562): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14562)] 20:59:43.764446 run osmo-stp_10.42.42.5(pid=14562): stdout: | (launched: 2022-12-09_20:59:42.431469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:43.894184 run osmo-stp_10.42.42.5(pid=14562): stderr: | 20221209205942603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205942603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205942603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205942604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205942604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205942604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205942605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:44.021226 run osmo-stp_10.42.42.5(pid=14562): stdout: | (launched: 2022-12-09_20:59:42.431469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:44.142990 run osmo-stp_10.42.42.5(pid=14562): stderr: | 20221209205942603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205942603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205942603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205942604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205942604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205942604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205942605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:44.288571 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14562): Process ended prematurely: osmo-stp_10.42.42.5(pid=14562) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14562)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 20:59:44.297652 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 20:59:44.324627 run osmo-hlr_10.42.42.2(pid=14559): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14559)] 20:59:44.372527 run osmo-hlr_10.42.42.2(pid=14559): stdout: | (launched: 2022-12-09_20:59:41.466965) 20:59:44.421896 run osmo-hlr_10.42.42.2(pid=14559): stderr: | 20221209205941646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205941646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205941646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205941646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205941646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205941646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205941658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205941668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205941668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205941668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:44.491017 run osmo-msc_10.42.42.6(pid=14565): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14565)] 20:59:44.538697 run osmo-msc_10.42.42.6(pid=14565): stdout: | (launched: 2022-12-09_20:59:43.407307) 20:59:44.588025 run osmo-msc_10.42.42.6(pid=14565): stderr: | 20221209205943679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205943679 DLGLOBAL DEBUG validating counter group 0x7fcbed403c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205943679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205943680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205943680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205943680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205943682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205943682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205943682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205943682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:44.637740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14558): Terminating (SIGTERM) 20:59:44.677371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14561): Terminating (SIGTERM) 20:59:44.717044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14564): Terminating (SIGTERM) 20:59:44.756832 --- ParallelTerminationStrategy: PID 14558 died... 20:59:44.775912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14558): Terminated: ok {rc=0} 20:59:44.820096 --- ParallelTerminationStrategy: PID 14561 died... 20:59:44.838681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14561): Terminated: ok {rc=0} 20:59:44.882573 --- ParallelTerminationStrategy: PID 14564 died... 20:59:44.901161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14564): Terminated: ok {rc=0} 20:59:44.987443 bus /sierra_3: Setting Powered False 20:59:46.104170 bus /sierra_3: Setting Powered False 20:59:47.240063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 20:59:48.483630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:59:48.490434 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 20:59:48.520208 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 20:59:48.546600 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 20:59:48.599555 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 20:59:48.628791 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 20:59:48.655300 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 20:59:49.205940 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 20:59:49.254901 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.266260 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:59:49.331230 tst mo_mt_call.py: using LAC 23690 20:59:49.450367 tst mo_mt_call.py: using RAC 230 20:59:49.571150 tst mo_mt_call.py: using CellId 23690 20:59:49.690108 tst mo_mt_call.py: using BVCI 23691 20:59:49.802576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.813930 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.825051 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.836490 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.848115 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:49.859440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:49.972107 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 20:59:50.091935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:59:50.599439 run create_hlr_db(pid=14571): Launched 20:59:50.732105 bus /sierra_2: Setting Powered False 20:59:51.796855 run create_hlr_db(pid=14571): Terminated: ok {rc=0} 20:59:52.251037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Launched 20:59:52.580257 run osmo-hlr_10.42.42.2(pid=14574): Launched 20:59:52.704898 run osmo-stp_10.42.42.5: Starting osmo-stp 20:59:53.266570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Launched 20:59:53.592209 run osmo-stp_10.42.42.5(pid=14577): Launched 20:59:53.716862 run osmo-msc_10.42.42.6: Starting osmo-msc 20:59:54.307526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Launched 20:59:54.635453 run osmo-msc_10.42.42.6(pid=14580): Launched 20:59:54.819790 run osmo-stp_10.42.42.5(pid=14577): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] 20:59:54.957422 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-09_20:59:53.532397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:55.095289 run osmo-stp_10.42.42.5(pid=14577): stderr: | 20221209205953725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205953726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205953726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205953726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205953727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205953727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205953727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:55.231790 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-09_20:59:53.532397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:59:55.361958 run osmo-stp_10.42.42.5(pid=14577): stderr: | 20221209205953725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209205953726 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209205953726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209205953726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209205953727 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209205953727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209205953727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:59:55.518242 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 20:59:55.527887 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 20:59:55.555937 run osmo-hlr_10.42.42.2(pid=14574): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14574)] 20:59:55.605728 run osmo-hlr_10.42.42.2(pid=14574): stdout: | (launched: 2022-12-09_20:59:52.519124) 20:59:55.657101 run osmo-hlr_10.42.42.2(pid=14574): stderr: | 20221209205952719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209205952719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209205952719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209205952719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209205952719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209205952719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209205952732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209205952740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209205952740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209205952740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:59:55.728735 run osmo-msc_10.42.42.6(pid=14580): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14580)] 20:59:55.778052 run osmo-msc_10.42.42.6(pid=14580): stdout: | (launched: 2022-12-09_20:59:54.575363) 20:59:55.828919 run osmo-msc_10.42.42.6(pid=14580): stderr: | 20221209205954899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209205954899 DLGLOBAL DEBUG validating counter group 0x7f6090304c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209205954899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209205954899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209205954899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209205954899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209205954901 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209205954901 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209205954902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209205954902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:59:55.880748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminating (SIGTERM) 20:59:55.922057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminating (SIGTERM) 20:59:55.963307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Terminating (SIGTERM) 20:59:56.004737 --- ParallelTerminationStrategy: PID 14573 died... 20:59:56.024674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminated: ok {rc=0} 20:59:56.071339 --- ParallelTerminationStrategy: PID 14576 died... 20:59:56.090947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminated: ok {rc=0} 20:59:56.136879 --- ParallelTerminationStrategy: PID 14579 died... 20:59:56.156936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Terminated: ok {rc=0} 20:59:56.245177 bus /sierra_3: Setting Powered False 20:59:57.344561 bus /sierra_3: Setting Powered False 20:59:58.461939 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 20:59:59.611278 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 20:59:59.623766 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 20:59:59.691231 tst mo_mt_call_osmux.py: using LAC 23691 20:59:59.819338 tst mo_mt_call_osmux.py: using RAC 231 20:59:59.948840 tst mo_mt_call_osmux.py: using CellId 23691 21:00:00.076514 tst mo_mt_call_osmux.py: using BVCI 23692 21:00:00.195340 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:00:00.207291 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:00:00.219016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:00:00.230719 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:00:00.242522 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:00:00.254309 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:00:00.377251 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:00:00.495952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:00.986198 run create_hlr_db(pid=14582): Launched 21:00:01.117903 bus /sierra_2: Setting Powered False 21:00:02.211401 run create_hlr_db(pid=14582): Terminated: ok {rc=0} 21:00:02.686234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14609): Launched 21:00:03.007493 run osmo-hlr_10.42.42.2(pid=14611): Launched 21:00:03.215821 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:03.845729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14630): Launched 21:00:04.151058 run osmo-stp_10.42.42.5(pid=14631): Launched 21:00:04.267572 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:04.818807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14633): Launched 21:00:05.125490 run osmo-msc_10.42.42.6(pid=14634): Launched 21:00:05.296374 run osmo-stp_10.42.42.5(pid=14631): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14631)] 21:00:05.425629 run osmo-stp_10.42.42.5(pid=14631): stdout: | (launched: 2022-12-09_21:00:04.094834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:05.554566 run osmo-stp_10.42.42.5(pid=14631): stderr: | 20221209210004264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210004264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210004264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210004265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210004265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210004265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210004265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:05.681465 run osmo-stp_10.42.42.5(pid=14631): stdout: | (launched: 2022-12-09_21:00:04.094834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:05.803212 run osmo-stp_10.42.42.5(pid=14631): stderr: | 20221209210004264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210004264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210004264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210004265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210004265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210004265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210004265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:05.948369 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14631): Process ended prematurely: osmo-stp_10.42.42.5(pid=14631) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14631)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:00:05.957480 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:00:05.984566 run osmo-hlr_10.42.42.2(pid=14611): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14611)] 21:00:06.031700 run osmo-hlr_10.42.42.2(pid=14611): stdout: | (launched: 2022-12-09_21:00:02.950758) 21:00:06.080386 run osmo-hlr_10.42.42.2(pid=14611): stderr: | 20221209210003260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210003260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210003260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210003260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210003260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210003260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210003286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210003307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210003307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210003307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:06.148930 run osmo-msc_10.42.42.6(pid=14634): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14634)] 21:00:06.195947 run osmo-msc_10.42.42.6(pid=14634): stdout: | (launched: 2022-12-09_21:00:05.068635) 21:00:06.244716 run osmo-msc_10.42.42.6(pid=14634): stderr: | 20221209210005341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210005341 DLGLOBAL DEBUG validating counter group 0x7f150810dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210005341 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210005341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210005341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210005342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210005344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210005344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210005344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210005344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:06.293858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14609): Terminating (SIGTERM) 21:00:06.333091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14630): Terminating (SIGTERM) 21:00:06.372191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14633): Terminating (SIGTERM) 21:00:06.411802 --- ParallelTerminationStrategy: PID 14609 died... 21:00:06.430707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14609): Terminated: ok {rc=0} 21:00:06.475174 --- ParallelTerminationStrategy: PID 14630 died... 21:00:06.493833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14630): Terminated: ok {rc=0} 21:00:06.537992 --- ParallelTerminationStrategy: PID 14633 died... 21:00:06.556682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14633): Terminated: ok {rc=0} 21:00:06.642755 bus /sierra_3: Setting Powered False 21:00:07.742718 bus /sierra_3: Setting Powered False 21:00:08.866307 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:00:10.115232 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:10.121209 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:00:10.150766 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 21:00:10.177116 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 21:00:10.228412 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:00:10.257112 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 21:00:10.283005 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 21:00:10.834669 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 21:00:10.884015 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:10.895060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:00:10.965329 tst mo_mt_call.py: using LAC 23692 21:00:11.084238 tst mo_mt_call.py: using RAC 232 21:00:11.202203 tst mo_mt_call.py: using CellId 23692 21:00:11.321782 tst mo_mt_call.py: using BVCI 23693 21:00:11.434129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:11.445139 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:11.455953 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:11.467013 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:11.478513 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:11.489368 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:11.609213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:11.726877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:12.200606 run create_hlr_db(pid=14640): Launched 21:00:12.316783 bus /sierra_2: Setting Powered False 21:00:13.377821 run create_hlr_db(pid=14640): Terminated: ok {rc=0} 21:00:13.823482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14642): Launched 21:00:14.151323 run osmo-hlr_10.42.42.2(pid=14644): Launched 21:00:14.276840 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:14.846280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14646): Launched 21:00:15.173971 run osmo-stp_10.42.42.5(pid=14647): Launched 21:00:15.303202 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:15.905731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14649): Launched 21:00:16.239574 run osmo-msc_10.42.42.6(pid=14650): Launched 21:00:16.465833 run osmo-stp_10.42.42.5(pid=14647): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14647)] 21:00:16.791400 run osmo-stp_10.42.42.5(pid=14647): stdout: | (launched: 2022-12-09_21:00:15.114082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:17.112399 run osmo-stp_10.42.42.5(pid=14647): stderr: | 20221209210015306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210015306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210015306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210015307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210015307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210015307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210015307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:17.324349 run osmo-stp_10.42.42.5(pid=14647): stdout: | (launched: 2022-12-09_21:00:15.114082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:17.449103 run osmo-stp_10.42.42.5(pid=14647): stderr: | 20221209210015306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210015306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210015306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210015307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210015307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210015307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210015307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:17.595743 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14647): Process ended prematurely: osmo-stp_10.42.42.5(pid=14647) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14647)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 21:00:17.604922 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 21:00:17.632738 run osmo-hlr_10.42.42.2(pid=14644): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14644)] 21:00:17.681912 run osmo-hlr_10.42.42.2(pid=14644): stdout: | (launched: 2022-12-09_21:00:14.091844) 21:00:17.731839 run osmo-hlr_10.42.42.2(pid=14644): stderr: | 20221209210014289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210014289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210014289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210014289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210014289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210014289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210014303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210014311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210014311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210014311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:17.801384 run osmo-msc_10.42.42.6(pid=14650): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14650)] 21:00:17.849579 run osmo-msc_10.42.42.6(pid=14650): stdout: | (launched: 2022-12-09_21:00:16.181851) 21:00:17.899617 run osmo-msc_10.42.42.6(pid=14650): stderr: | 20221209210016910 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210016912 DLGLOBAL DEBUG validating counter group 0x7f9bc285ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210016913 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210016913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210016914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210016916 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210016923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210016925 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210016926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210016927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:17.949745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14642): Terminating (SIGTERM) 21:00:17.988882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14646): Terminating (SIGTERM) 21:00:18.029895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14649): Terminating (SIGTERM) 21:00:18.070405 --- ParallelTerminationStrategy: PID 14642 died... 21:00:18.089608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14642): Terminated: ok {rc=0} 21:00:18.134643 --- ParallelTerminationStrategy: PID 14646 died... 21:00:18.153328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14646): Terminated: ok {rc=0} 21:00:18.198090 --- ParallelTerminationStrategy: PID 14649 died... 21:00:18.216687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14649): Terminated: ok {rc=0} 21:00:18.301555 bus /sierra_3: Setting Powered False 21:00:19.400552 bus /sierra_3: Setting Powered False 21:00:20.514812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 21:00:21.661002 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:21.672735 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:00:21.738903 tst mo_mt_call_osmux.py: using LAC 23693 21:00:21.858591 tst mo_mt_call_osmux.py: using RAC 233 21:00:21.984101 tst mo_mt_call_osmux.py: using CellId 23693 21:00:22.104077 tst mo_mt_call_osmux.py: using BVCI 23694 21:00:22.215355 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:22.226600 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:22.237481 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:22.248432 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:22.259675 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 21:00:22.270865 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:22.390217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 21:00:22.511978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:23.021229 run create_hlr_db(pid=14652): Launched 21:00:23.154240 bus /sierra_2: Setting Powered False 21:00:24.219171 run create_hlr_db(pid=14652): Terminated: ok {rc=0} 21:00:24.656158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Launched 21:00:24.963047 run osmo-hlr_10.42.42.2(pid=14655): Launched 21:00:25.081897 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:25.619562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Launched 21:00:25.924781 run osmo-stp_10.42.42.5(pid=14658): Launched 21:00:26.040374 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:26.590682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14660): Launched 21:00:26.894989 run osmo-msc_10.42.42.6(pid=14661): Launched 21:00:27.066157 run osmo-stp_10.42.42.5(pid=14658): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] 21:00:27.195261 run osmo-stp_10.42.42.5(pid=14658): stdout: | (launched: 2022-12-09_21:00:25.868531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:27.324564 run osmo-stp_10.42.42.5(pid=14658): stderr: | 20221209210026040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210026040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210026040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210026041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210026041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210026041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210026041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:27.451101 run osmo-stp_10.42.42.5(pid=14658): stdout: | (launched: 2022-12-09_21:00:25.868531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:27.571962 run osmo-stp_10.42.42.5(pid=14658): stderr: | 20221209210026040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210026040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210026040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210026041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210026041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210026041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210026041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:27.717080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14658): Process ended prematurely: osmo-stp_10.42.42.5(pid=14658) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 21:00:27.726045 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:00:27.752878 run osmo-hlr_10.42.42.2(pid=14655): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14655)] 21:00:27.800564 run osmo-hlr_10.42.42.2(pid=14655): stdout: | (launched: 2022-12-09_21:00:24.906658) 21:00:27.849529 run osmo-hlr_10.42.42.2(pid=14655): stderr: | 20221209210025082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210025082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210025082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210025082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210025082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210025082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210025094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210025103 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210025103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210025103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:27.918348 run osmo-msc_10.42.42.6(pid=14661): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14661)] 21:00:27.965514 run osmo-msc_10.42.42.6(pid=14661): stdout: | (launched: 2022-12-09_21:00:26.838630) 21:00:28.014490 run osmo-msc_10.42.42.6(pid=14661): stderr: | 20221209210027108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210027108 DLGLOBAL DEBUG validating counter group 0x7f5ea8ffac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210027108 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210027108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210027108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210027109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210027110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210027111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210027111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210027111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:28.063682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Terminating (SIGTERM) 21:00:28.102626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Terminating (SIGTERM) 21:00:28.141669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14660): Terminating (SIGTERM) 21:00:28.181184 --- ParallelTerminationStrategy: PID 14654 died... 21:00:28.200037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Terminated: ok {rc=0} 21:00:28.243896 --- ParallelTerminationStrategy: PID 14657 died... 21:00:28.262366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Terminated: ok {rc=0} 21:00:28.305642 --- ParallelTerminationStrategy: PID 14660 died... 21:00:28.323947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14660): Terminated: ok {rc=0} 21:00:28.405734 bus /sierra_3: Setting Powered False 21:00:29.500763 bus /sierra_3: Setting Powered False 21:00:30.616627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 21:00:31.894864 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:31.901709 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:00:31.940929 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:00:31.975943 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:00:32.079801 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:00:32.118095 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:00:32.153227 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:00:32.725126 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 21:00:32.730493 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:32.741930 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:32.788920 tst emergency_mo_mt_call.py: using LAC 23694 21:00:32.907443 tst emergency_mo_mt_call.py: using RAC 234 21:00:33.025878 tst emergency_mo_mt_call.py: using CellId 23694 21:00:33.152833 tst emergency_mo_mt_call.py: using BVCI 23695 21:00:33.269316 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:33.280842 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:33.292078 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:33.303541 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:33.315052 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:33.326803 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:33.443871 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:33.561584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:34.060443 run create_hlr_db(pid=14666): Launched 21:00:34.190817 bus /sierra_2: Setting Powered False 21:00:35.254860 run create_hlr_db(pid=14666): Terminated: ok {rc=0} 21:00:35.703411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Launched 21:00:36.024663 run osmo-hlr_10.42.42.2(pid=14669): Launched 21:00:36.147927 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:36.702319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Launched 21:00:37.022149 run osmo-stp_10.42.42.5(pid=14672): Launched 21:00:37.154134 tst emergency_mo_mt_call.py: using MSISDN 7374 21:00:37.317808 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:37.899242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Launched 21:00:38.221722 run osmo-msc_10.42.42.6(pid=14675): Launched 21:00:38.402133 run osmo-stp_10.42.42.5(pid=14672): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] 21:00:38.536813 run osmo-stp_10.42.42.5(pid=14672): stdout: | (launched: 2022-12-09_21:00:36.963121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:38.672140 run osmo-stp_10.42.42.5(pid=14672): stderr: | 20221209210037154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210037155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210037155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210037155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210037156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210037156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210037156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:38.806631 run osmo-stp_10.42.42.5(pid=14672): stdout: | (launched: 2022-12-09_21:00:36.963121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:38.934680 run osmo-stp_10.42.42.5(pid=14672): stderr: | 20221209210037154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210037155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210037155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210037155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210037156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210037156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210037156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:39.087483 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14672): Process ended prematurely: osmo-stp_10.42.42.5(pid=14672) [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 21:00:39.096423 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 21:00:39.124027 run osmo-hlr_10.42.42.2(pid=14669): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14669)] 21:00:39.173860 run osmo-hlr_10.42.42.2(pid=14669): stdout: | (launched: 2022-12-09_21:00:35.965915) 21:00:39.225249 run osmo-hlr_10.42.42.2(pid=14669): stderr: | 20221209210036163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210036163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210036164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210036164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210036164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210036164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210036176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210036185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210036185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210036185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:39.296759 run osmo-msc_10.42.42.6(pid=14675): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14675)] 21:00:39.346198 run osmo-msc_10.42.42.6(pid=14675): stdout: | (launched: 2022-12-09_21:00:38.162903) 21:00:39.397382 run osmo-msc_10.42.42.6(pid=14675): stderr: | 20221209210038486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210038486 DLGLOBAL DEBUG validating counter group 0x7f5511412c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210038486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210038486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210038486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210038486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210038488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210038489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210038489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210038489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:39.448887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Terminating (SIGTERM) 21:00:39.489839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Terminating (SIGTERM) 21:00:39.530938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Terminating (SIGTERM) 21:00:39.572292 --- ParallelTerminationStrategy: PID 14668 died... 21:00:39.592150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Terminated: ok {rc=0} 21:00:39.637877 --- ParallelTerminationStrategy: PID 14671 died... 21:00:39.657281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Terminated: ok {rc=0} 21:00:39.702710 --- ParallelTerminationStrategy: PID 14674 died... 21:00:39.722227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Terminated: ok {rc=0} 21:00:39.808289 bus /sierra_3: Setting Powered False 21:00:40.907938 bus /sierra_3: Setting Powered False 21:00:42.022498 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 21:00:43.109708 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.122435 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:43.170860 tst emergency_preemptive_call.py: using LAC 23695 21:00:43.298613 tst emergency_preemptive_call.py: using RAC 235 21:00:43.428268 tst emergency_preemptive_call.py: using CellId 23695 21:00:43.554674 tst emergency_preemptive_call.py: using BVCI 23696 21:00:43.671023 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.682375 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.693514 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.704533 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.715628 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:00:43.726701 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:43.844102 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:43.963307 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:44.077854 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:44.190500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:00:44.691898 run create_hlr_db(pid=14677): Launched 21:00:44.812786 bus /sierra_2: Setting Powered False 21:00:45.880847 run create_hlr_db(pid=14677): Terminated: ok {rc=0} 21:00:46.325800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14679): Launched 21:00:46.638807 run osmo-hlr_10.42.42.2(pid=14680): Launched 21:00:46.880392 run osmo-stp_10.42.42.5: Starting osmo-stp 21:00:47.499615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14682): Launched 21:00:47.800796 run osmo-stp_10.42.42.5(pid=14683): Launched 21:00:47.923184 tst emergency_preemptive_call.py: using MSISDN 7375 21:00:48.091245 run osmo-msc_10.42.42.6: Starting osmo-msc 21:00:48.627868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14685): Launched 21:00:48.926807 run osmo-msc_10.42.42.6(pid=14686): Launched 21:00:49.094582 run osmo-stp_10.42.42.5(pid=14683): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14683)] 21:00:49.221456 run osmo-stp_10.42.42.5(pid=14683): stdout: | (launched: 2022-12-09_21:00:47.745086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:49.348649 run osmo-stp_10.42.42.5(pid=14683): stderr: | 20221209210047915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210047915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210047916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210047917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210047917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210047918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210047918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:49.474142 run osmo-stp_10.42.42.5(pid=14683): stdout: | (launched: 2022-12-09_21:00:47.745086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:00:49.593653 run osmo-stp_10.42.42.5(pid=14683): stderr: | 20221209210047915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210047915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210047916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210047917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210047917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210047918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210047918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:00:49.736715 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14683): Process ended prematurely: osmo-stp_10.42.42.5(pid=14683) [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14683)] [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 21:00:49.745297 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 21:00:49.771806 run osmo-hlr_10.42.42.2(pid=14680): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14680)] 21:00:49.819479 run osmo-hlr_10.42.42.2(pid=14680): stdout: | (launched: 2022-12-09_21:00:46.580823) 21:00:49.868890 run osmo-hlr_10.42.42.2(pid=14680): stderr: | 20221209210046920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210046920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210046920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210046920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210046920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210046920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210046939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210046948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210046948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210046948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:00:49.938109 run osmo-msc_10.42.42.6(pid=14686): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14686)] 21:00:49.985608 run osmo-msc_10.42.42.6(pid=14686): stdout: | (launched: 2022-12-09_21:00:48.871573) 21:00:50.034811 run osmo-msc_10.42.42.6(pid=14686): stderr: | 20221209210049142 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210049143 DLGLOBAL DEBUG validating counter group 0x7f3d59670c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210049143 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210049143 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210049143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210049143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210049145 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210049145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210049146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210049146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:00:50.084377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14679): Terminating (SIGTERM) 21:00:50.123924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14682): Terminating (SIGTERM) 21:00:50.163468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14685): Terminating (SIGTERM) 21:00:50.203109 --- ParallelTerminationStrategy: PID 14679 died... 21:00:50.222336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14679): Terminated: ok {rc=0} 21:00:50.266706 --- ParallelTerminationStrategy: PID 14682 died... 21:00:50.285254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14682): Terminated: ok {rc=0} 21:00:50.328807 --- ParallelTerminationStrategy: PID 14685 died... 21:00:50.347926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14685): Terminated: ok {rc=0} 21:00:50.433579 bus /sierra_9: Setting Powered False 21:00:51.531941 bus /sierra_9: Setting Powered False 21:00:52.647054 bus /sierra_8: Setting Powered False 21:00:53.745618 bus /sierra_8: Setting Powered False 21:00:54.859604 bus /sierra_3: Setting Powered False 21:00:55.957995 bus /sierra_3: Setting Powered False 21:00:57.073961 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 21:00:58.347971 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:00:58.353663 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 21:00:58.384022 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 21:00:58.423858 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 21:00:58.511143 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 21:00:58.541363 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 21:00:58.581524 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 21:00:59.176611 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 21:00:59.230023 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.241230 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:00:59.285622 tst cs_paging_gprs_active.py: using LAC 23696 21:00:59.413762 tst cs_paging_gprs_active.py: using RAC 236 21:00:59.541267 tst cs_paging_gprs_active.py: using CellId 23696 21:00:59.660744 tst cs_paging_gprs_active.py: using BVCI 23697 21:00:59.773776 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.784728 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.795444 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.806666 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.817932 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.829126 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.840404 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.851497 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:00:59.862881 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:00:59.983558 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:00.101590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:01:00.308077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:00.615173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14691): Launched 21:01:00.881735 run iperf3-srv_10.42.42.10(pid=14692): Launched 21:01:01.019683 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:01:01.247439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:01.590034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14693): Launched 21:01:01.891921 run iperf3-srv_10.42.42.10(pid=14694): Launched 21:01:02.030554 tst cs_paging_gprs_active.py:38: start network... 21:01:02.256667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:02.764755 run create_hlr_db(pid=14695): Launched 21:01:02.898918 bus /sierra_2: Setting Powered False 21:01:03.964004 run create_hlr_db(pid=14695): Terminated: ok {rc=0} 21:01:04.418361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Launched 21:01:04.745515 run osmo-hlr_10.42.42.2(pid=14698): Launched 21:01:04.868749 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:05.434658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14700): Launched 21:01:05.762940 run osmo-stp_10.42.42.5(pid=14701): Launched 21:01:05.886872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:06.450193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14703): Launched 21:01:06.576597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:06.853429 run patchelf(pid=14704): Launched 21:01:07.035692 run osmo-stp_10.42.42.5(pid=14701): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14701)] 21:01:07.174291 run osmo-stp_10.42.42.5(pid=14701): stdout: | (launched: 2022-12-09_21:01:05.703236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:07.314113 run osmo-stp_10.42.42.5(pid=14701): stderr: | 20221209210105894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210105895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210105895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210105895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210105896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210105896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210105896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:07.453673 run osmo-stp_10.42.42.5(pid=14701): stdout: | (launched: 2022-12-09_21:01:05.703236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:07.587243 run osmo-stp_10.42.42.5(pid=14701): stderr: | 20221209210105894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210105895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210105895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210105895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210105896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210105896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210105896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:07.745967 run patchelf(pid=14704): Terminating (SIGINT) 21:01:07.929544 run patchelf(pid=14704): Terminated: ok {rc=0} 21:01:08.061634 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14701): Process ended prematurely: osmo-stp_10.42.42.5(pid=14701) [trial-2364↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14701)] [trial-2364↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 21:01:08.071886 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:01:08.100767 run osmo-hlr_10.42.42.2(pid=14698): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14698)] 21:01:08.150404 run osmo-hlr_10.42.42.2(pid=14698): stdout: | (launched: 2022-12-09_21:01:04.685655) 21:01:08.201669 run osmo-hlr_10.42.42.2(pid=14698): stderr: | 20221209210104885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210104885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210104885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210104885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210104885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210104885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210104897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210104905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210104906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210104906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:08.253091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14691): Terminating (SIGTERM) 21:01:08.294257 run iperf3-srv_10.42.42.10(pid=14692): Terminating (SIGTERM) 21:01:08.335625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14693): Terminating (SIGTERM) 21:01:08.377072 run iperf3-srv_10.42.42.10(pid=14694): Terminating (SIGTERM) 21:01:08.418113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Terminating (SIGTERM) 21:01:08.459350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14700): Terminating (SIGTERM) 21:01:08.500588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14703): Terminating (SIGTERM) 21:01:08.542474 --- ParallelTerminationStrategy: PID 14691 died... 21:01:08.562426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14691): Terminated: ok {rc=0} 21:01:08.608704 --- ParallelTerminationStrategy: PID 14692 died... 21:01:08.628320 run iperf3-srv_10.42.42.10(pid=14692): Terminated {rc=256} 21:01:08.674338 --- ParallelTerminationStrategy: PID 14693 died... 21:01:08.693860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14693): Terminated: ok {rc=0} 21:01:08.739817 --- ParallelTerminationStrategy: PID 14694 died... 21:01:08.759284 run iperf3-srv_10.42.42.10(pid=14694): Terminated {rc=256} 21:01:08.805225 --- ParallelTerminationStrategy: PID 14697 died... 21:01:08.824703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Terminated: ok {rc=0} 21:01:08.870946 --- ParallelTerminationStrategy: PID 14700 died... 21:01:08.890656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14700): Terminated: ok {rc=0} 21:01:08.937145 --- ParallelTerminationStrategy: PID 14703 died... 21:01:08.956617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14703): Terminated: ok {rc=0} 21:01:09.043025 bus /gobi_0: Setting Powered False 21:01:10.141125 bus /gobi_0: Setting Powered False 21:01:11.254695 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 21:01:12.403807 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:12.415778 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:12.464895 tst iperf3.py: using LAC 23697 21:01:12.602252 tst iperf3.py: using RAC 237 21:01:12.729486 tst iperf3.py: using CellId 23697 21:01:12.857386 tst iperf3.py: using BVCI 23698 21:01:12.977453 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:12.988770 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:12.999957 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.011366 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.022676 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.033980 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.045626 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.056754 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:13.068327 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:13.184596 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:13.405671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:13.734623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14705): Launched 21:01:14.020839 run iperf3-srv_10.42.42.10(pid=14706): Launched 21:01:14.143369 tst iperf3.py:8: start network... 21:01:14.364494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:14.870392 run create_hlr_db(pid=14707): Launched 21:01:15.004897 bus /gobi_6: Setting Powered False 21:01:16.098249 run create_hlr_db(pid=14707): Terminated: ok {rc=0} 21:01:16.559495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14709): Launched 21:01:16.965850 run osmo-hlr_10.42.42.2(pid=14710): Launched 21:01:17.093592 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:17.777747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14712): Launched 21:01:18.083294 run osmo-stp_10.42.42.5(pid=14713): Launched 21:01:18.199476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:18.725599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14715): Launched 21:01:18.841754 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:19.099601 run patchelf(pid=14716): Launched 21:01:19.268879 run osmo-stp_10.42.42.5(pid=14713): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14713)] 21:01:19.398301 run osmo-stp_10.42.42.5(pid=14713): stdout: | (launched: 2022-12-09_21:01:18.027112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:19.529317 run osmo-stp_10.42.42.5(pid=14713): stderr: | 20221209210118198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210118198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210118198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210118198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210118199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210118199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210118199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:19.660455 run osmo-stp_10.42.42.5(pid=14713): stdout: | (launched: 2022-12-09_21:01:18.027112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:19.786109 run osmo-stp_10.42.42.5(pid=14713): stderr: | 20221209210118198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210118198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210118198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210118198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210118199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210118199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210118199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:19.934712 run patchelf(pid=14716): Terminating (SIGINT) 21:01:20.106517 run patchelf(pid=14716): Terminated: ok {rc=0} 21:01:20.230050 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14713): Process ended prematurely: osmo-stp_10.42.42.5(pid=14713) [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14713)] [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 21:01:20.239586 tst iperf3.py:8: Test FAILED (7.9 sec) 21:01:20.267390 run osmo-hlr_10.42.42.2(pid=14710): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14710)] 21:01:20.315352 run osmo-hlr_10.42.42.2(pid=14710): stdout: | (launched: 2022-12-09_21:01:16.904384) 21:01:20.365006 run osmo-hlr_10.42.42.2(pid=14710): stderr: | 20221209210117294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210117295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210117295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210117295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210117295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210117295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210117311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210117324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210117333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210117333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:20.415255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14705): Terminating (SIGTERM) 21:01:20.454960 run iperf3-srv_10.42.42.10(pid=14706): Terminating (SIGTERM) 21:01:20.494427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14709): Terminating (SIGTERM) 21:01:20.534215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14712): Terminating (SIGTERM) 21:01:20.573854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14715): Terminating (SIGTERM) 21:01:20.613949 --- ParallelTerminationStrategy: PID 14705 died... 21:01:20.632593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14705): Terminated: ok {rc=0} 21:01:20.677311 --- ParallelTerminationStrategy: PID 14706 died... 21:01:20.695918 run iperf3-srv_10.42.42.10(pid=14706): Terminated {rc=256} 21:01:20.740182 --- ParallelTerminationStrategy: PID 14709 died... 21:01:20.759002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14709): Terminated: ok {rc=0} 21:01:20.803275 --- ParallelTerminationStrategy: PID 14712 died... 21:01:20.821993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14712): Terminated: ok {rc=0} 21:01:20.866073 --- ParallelTerminationStrategy: PID 14715 died... 21:01:20.884763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14715): Terminated: ok {rc=0} 21:01:20.970732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 21:01:22.122775 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.134979 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:22.182219 tst iperf3m4.py: using LAC 23698 21:01:22.311745 tst iperf3m4.py: using RAC 238 21:01:22.439776 tst iperf3m4.py: using CellId 23698 21:01:22.570778 tst iperf3m4.py: using BVCI 23699 21:01:22.691559 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.703150 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.714386 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.725727 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.737086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.748332 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.759933 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.771218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:22.782785 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:22.904117 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:23.025400 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:23.141970 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:23.262155 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:01:23.468073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:23.776640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14717): Launched 21:01:24.042830 run iperf3-srv_10.42.42.10(pid=14718): Launched 21:01:24.157274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:01:24.361487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:24.669302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14719): Launched 21:01:24.934990 run iperf3-srv_10.42.42.10(pid=14720): Launched 21:01:25.049561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:01:25.253805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:25.561156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14721): Launched 21:01:25.828080 run iperf3-srv_10.42.42.10(pid=14722): Launched 21:01:25.942507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:01:26.147115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:01:26.454697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14723): Launched 21:01:26.722367 run iperf3-srv_10.42.42.10(pid=14724): Launched 21:01:26.836801 tst iperf3m4.py:8: start network... 21:01:27.041823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:27.516804 run create_hlr_db(pid=14725): Launched 21:01:27.650680 bus /gobi_6: Setting Powered False 21:01:28.714737 run create_hlr_db(pid=14725): Terminated: ok {rc=0} 21:01:29.168200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Launched 21:01:29.496797 run osmo-hlr_10.42.42.2(pid=14728): Launched 21:01:29.620914 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:30.283512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Launched 21:01:30.603159 run osmo-stp_10.42.42.5(pid=14731): Launched 21:01:30.723664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:31.354193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14733): Launched 21:01:31.483452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:31.758759 run patchelf(pid=14734): Launched 21:01:31.952477 run osmo-stp_10.42.42.5(pid=14731): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] 21:01:32.091556 run osmo-stp_10.42.42.5(pid=14731): stdout: | (launched: 2022-12-09_21:01:30.544428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:32.229613 run osmo-stp_10.42.42.5(pid=14731): stderr: | 20221209210130733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210130733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210130733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210130733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210130734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210130734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210130734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:32.366704 run osmo-stp_10.42.42.5(pid=14731): stdout: | (launched: 2022-12-09_21:01:30.544428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:32.498068 run osmo-stp_10.42.42.5(pid=14731): stderr: | 20221209210130733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210130733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210130733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210130733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210130734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210130734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210130734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:32.653611 run patchelf(pid=14734): Terminating (SIGINT) 21:01:32.832382 run patchelf(pid=14734): Terminated: ok {rc=0} 21:01:32.962289 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14731): Process ended prematurely: osmo-stp_10.42.42.5(pid=14731) [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 21:01:32.972923 tst iperf3m4.py:8: Test FAILED (10.9 sec) 21:01:33.002566 run osmo-hlr_10.42.42.2(pid=14728): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14728)] 21:01:33.052364 run osmo-hlr_10.42.42.2(pid=14728): stdout: | (launched: 2022-12-09_21:01:29.436625) 21:01:33.103991 run osmo-hlr_10.42.42.2(pid=14728): stderr: | 20221209210129635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210129635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210129635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210129635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210129635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210129635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210129647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210129656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210129656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210129656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:33.156025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14717): Terminating (SIGTERM) 21:01:33.197644 run iperf3-srv_10.42.42.10(pid=14718): Terminating (SIGTERM) 21:01:33.239262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14719): Terminating (SIGTERM) 21:01:33.281060 run iperf3-srv_10.42.42.10(pid=14720): Terminating (SIGTERM) 21:01:33.322495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14721): Terminating (SIGTERM) 21:01:33.364416 run iperf3-srv_10.42.42.10(pid=14722): Terminating (SIGTERM) 21:01:33.406086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14723): Terminating (SIGTERM) 21:01:33.447737 run iperf3-srv_10.42.42.10(pid=14724): Terminating (SIGTERM) 21:01:33.490668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Terminating (SIGTERM) 21:01:33.532597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Terminating (SIGTERM) 21:01:33.574293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14733): Terminating (SIGTERM) 21:01:33.616251 --- ParallelTerminationStrategy: PID 14717 died... 21:01:33.636240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14717): Terminated: ok {rc=0} 21:01:33.682507 --- ParallelTerminationStrategy: PID 14718 died... 21:01:33.702081 run iperf3-srv_10.42.42.10(pid=14718): Terminated {rc=256} 21:01:33.747813 --- ParallelTerminationStrategy: PID 14719 died... 21:01:33.767362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14719): Terminated: ok {rc=0} 21:01:33.813612 --- ParallelTerminationStrategy: PID 14720 died... 21:01:33.833258 run iperf3-srv_10.42.42.10(pid=14720): Terminated {rc=256} 21:01:33.879010 --- ParallelTerminationStrategy: PID 14721 died... 21:01:33.898557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14721): Terminated: ok {rc=0} 21:01:33.945174 --- ParallelTerminationStrategy: PID 14722 died... 21:01:33.964474 run iperf3-srv_10.42.42.10(pid=14722): Terminated {rc=256} 21:01:34.009966 --- ParallelTerminationStrategy: PID 14723 died... 21:01:34.029341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14723): Terminated: ok {rc=0} 21:01:34.074697 --- ParallelTerminationStrategy: PID 14724 died... 21:01:34.094231 run iperf3-srv_10.42.42.10(pid=14724): Terminated {rc=256} 21:01:34.139558 --- ParallelTerminationStrategy: PID 14727 died... 21:01:34.159142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Terminated: ok {rc=0} 21:01:34.204543 --- ParallelTerminationStrategy: PID 14730 died... 21:01:34.223994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Terminated: ok {rc=0} 21:01:34.269729 --- ParallelTerminationStrategy: PID 14733 died... 21:01:34.289221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14733): Terminated: ok {rc=0} 21:01:34.375461 bus /gobi_4: Setting Powered False 21:01:35.474323 bus /gobi_4: Setting Powered False 21:01:36.588820 bus /gobi_1: Setting Powered False 21:01:37.686397 bus /gobi_1: Setting Powered False 21:01:38.801241 bus /gobi_0: Setting Powered False 21:01:39.897886 bus /gobi_0: Setting Powered False 21:01:41.012637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 21:01:42.112549 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.124504 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:42.170840 tst ping.py: using LAC 23699 21:01:42.296103 tst ping.py: using RAC 239 21:01:42.413718 tst ping.py: using CellId 23699 21:01:42.537393 tst ping.py: using BVCI 23700 21:01:42.651598 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.662917 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.674246 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.685486 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.696418 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.707286 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.718433 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:42.729540 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:42.848125 tst ping.py:19: start network... 21:01:43.059777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:43.546847 run create_hlr_db(pid=14735): Launched 21:01:43.675357 bus /gobi_6: Setting Powered False 21:01:44.738160 run create_hlr_db(pid=14735): Terminated: ok {rc=0} 21:01:45.159309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14737): Launched 21:01:45.453701 run osmo-hlr_10.42.42.2(pid=14738): Launched 21:01:45.566462 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:46.123328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14740): Launched 21:01:46.523140 run osmo-stp_10.42.42.5(pid=14741): Launched 21:01:46.791313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:47.432100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14743): Launched 21:01:47.555042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:47.820360 run patchelf(pid=14744): Launched 21:01:47.997350 run osmo-stp_10.42.42.5(pid=14741): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14741)] 21:01:48.130150 run osmo-stp_10.42.42.5(pid=14741): stdout: | (launched: 2022-12-09_21:01:46.451542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:48.264735 run osmo-stp_10.42.42.5(pid=14741): stderr: | 20221209210146710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210146710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210146710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210146711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210146711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210146711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210146711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:48.399311 run osmo-stp_10.42.42.5(pid=14741): stdout: | (launched: 2022-12-09_21:01:46.451542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:48.527733 run osmo-stp_10.42.42.5(pid=14741): stderr: | 20221209210146710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210146710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210146710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210146711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210146711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210146711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210146711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:48.680117 run patchelf(pid=14744): Terminating (SIGINT) 21:01:48.855915 run patchelf(pid=14744): Terminated: ok {rc=0} 21:01:48.983220 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14741): Process ended prematurely: osmo-stp_10.42.42.5(pid=14741) [trial-2364↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14741)] [trial-2364↪gprs:trx-lms-limenet-micro↪ping.py:22] 21:01:48.992758 tst ping.py:22: Test FAILED (6.9 sec) 21:01:49.020455 run osmo-hlr_10.42.42.2(pid=14738): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14738)] 21:01:49.069985 run osmo-hlr_10.42.42.2(pid=14738): stdout: | (launched: 2022-12-09_21:01:45.399304) 21:01:49.121205 run osmo-hlr_10.42.42.2(pid=14738): stderr: | 20221209210145574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210145574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210145574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210145574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210145574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210145574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210145586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210145595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210145595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210145595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:49.172417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14737): Terminating (SIGTERM) 21:01:49.214016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14740): Terminating (SIGTERM) 21:01:49.255707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14743): Terminating (SIGTERM) 21:01:49.297198 --- ParallelTerminationStrategy: PID 14737 died... 21:01:49.316890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14737): Terminated: ok {rc=0} 21:01:49.362704 --- ParallelTerminationStrategy: PID 14740 died... 21:01:49.382024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14740): Terminated: ok {rc=0} 21:01:49.427262 --- ParallelTerminationStrategy: PID 14743 died... 21:01:49.446600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14743): Terminated: ok {rc=0} 21:01:49.532662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 21:01:50.620651 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:50.633084 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 21:01:50.679785 tst ping_idle_ping.py: using LAC 23700 21:01:50.804157 tst ping_idle_ping.py: using RAC 240 21:01:50.922003 tst ping_idle_ping.py: using CellId 23700 21:01:51.038466 tst ping_idle_ping.py: using BVCI 23701 21:01:51.148129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.159007 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.169795 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.180809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.192052 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.202952 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.214129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 21:01:51.224683 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 21:01:51.341954 tst ping_idle_ping.py:24: start network... 21:01:51.554744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:01:52.048678 run create_hlr_db(pid=14745): Launched 21:01:52.177494 bus /gobi_6: Setting Powered False 21:01:53.240042 run create_hlr_db(pid=14745): Terminated: ok {rc=0} 21:01:53.662466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14747): Launched 21:01:53.960703 run osmo-hlr_10.42.42.2(pid=14748): Launched 21:01:54.074191 run osmo-stp_10.42.42.5: Starting osmo-stp 21:01:54.598594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14750): Launched 21:01:54.893408 run osmo-stp_10.42.42.5(pid=14751): Launched 21:01:55.005922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:01:55.516017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14753): Launched 21:01:55.629145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:01:55.879681 run patchelf(pid=14754): Launched 21:01:56.044337 run osmo-stp_10.42.42.5(pid=14751): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14751)] 21:01:56.169852 run osmo-stp_10.42.42.5(pid=14751): stdout: | (launched: 2022-12-09_21:01:54.838993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:56.297134 run osmo-stp_10.42.42.5(pid=14751): stderr: | 20221209210155007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210155007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210155007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210155007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210155008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210155008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210155008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:56.424335 run osmo-stp_10.42.42.5(pid=14751): stdout: | (launched: 2022-12-09_21:01:54.838993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:01:56.545625 run osmo-stp_10.42.42.5(pid=14751): stderr: | 20221209210155007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210155007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210155007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210155007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210155008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210155008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210155008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:01:56.689636 run patchelf(pid=14754): Terminating (SIGINT) 21:01:56.855718 run patchelf(pid=14754): Terminated: ok {rc=0} 21:01:56.975849 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14751): Process ended prematurely: osmo-stp_10.42.42.5(pid=14751) [trial-2364↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14751)] [trial-2364↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 21:01:56.984850 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:01:57.011661 run osmo-hlr_10.42.42.2(pid=14748): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14748)] 21:01:57.058789 run osmo-hlr_10.42.42.2(pid=14748): stdout: | (launched: 2022-12-09_21:01:53.906160) 21:01:57.107791 run osmo-hlr_10.42.42.2(pid=14748): stderr: | 20221209210154081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210154081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210154082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210154082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210154082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210154082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210154094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210154102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210154102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210154103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:01:57.157354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14747): Terminating (SIGTERM) 21:01:57.196785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14750): Terminating (SIGTERM) 21:01:57.236274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14753): Terminating (SIGTERM) 21:01:57.275626 --- ParallelTerminationStrategy: PID 14747 died... 21:01:57.294483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14747): Terminated: ok {rc=0} 21:01:57.338599 --- ParallelTerminationStrategy: PID 14750 died... 21:01:57.356832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14750): Terminated: ok {rc=0} 21:01:57.400228 --- ParallelTerminationStrategy: PID 14753 died... 21:01:57.418403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14753): Terminated: ok {rc=0} 21:01:57.501165 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 21:01:58.794924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:01:58.800207 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:01:58.829553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:01:58.867784 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:01:58.959335 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:01:58.989281 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:01:59.027223 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:01:59.615894 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:01:59.664658 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:01:59.675593 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:01:59.719598 tst cs_paging_gprs_active.py: using LAC 23701 21:01:59.837352 tst cs_paging_gprs_active.py: using RAC 241 21:01:59.953595 tst cs_paging_gprs_active.py: using CellId 23701 21:02:00.081321 tst cs_paging_gprs_active.py: using BVCI 23702 21:02:00.200373 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.211955 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.223240 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.234621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.245734 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.256930 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.268241 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.279432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:00.290774 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:00.407483 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:00.525132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:02:00.743603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:01.092382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14759): Launched 21:02:01.452216 run iperf3-srv_10.42.42.10(pid=14760): Launched 21:02:01.602987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:02:01.827262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:02.162578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14761): Launched 21:02:02.453303 run iperf3-srv_10.42.42.10(pid=14762): Launched 21:02:02.573936 tst cs_paging_gprs_active.py:38: start network... 21:02:02.791232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:03.292435 run create_hlr_db(pid=14763): Launched 21:02:03.424043 bus /gobi_6: Setting Powered False 21:02:04.488086 run create_hlr_db(pid=14763): Terminated: ok {rc=0} 21:02:04.938742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14765): Launched 21:02:05.264271 run osmo-hlr_10.42.42.2(pid=14766): Launched 21:02:05.390775 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:05.943047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14768): Launched 21:02:06.267336 run osmo-stp_10.42.42.5(pid=14769): Launched 21:02:06.388620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:06.945232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14771): Launched 21:02:07.067517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:07.340370 run patchelf(pid=14772): Launched 21:02:07.518965 run osmo-stp_10.42.42.5(pid=14769): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14769)] 21:02:07.655554 run osmo-stp_10.42.42.5(pid=14769): stdout: | (launched: 2022-12-09_21:02:06.208419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:07.793407 run osmo-stp_10.42.42.5(pid=14769): stderr: | 20221209210206400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210206400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210206400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210206400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210206401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210206401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210206401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:07.931457 run osmo-stp_10.42.42.5(pid=14769): stdout: | (launched: 2022-12-09_21:02:06.208419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:08.063929 run osmo-stp_10.42.42.5(pid=14769): stderr: | 20221209210206400 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210206400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210206400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210206400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210206401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210206401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210206401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:08.220780 run patchelf(pid=14772): Terminating (SIGINT) 21:02:08.401082 run patchelf(pid=14772): Terminated: ok {rc=0} 21:02:08.531116 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14769): Process ended prematurely: osmo-stp_10.42.42.5(pid=14769) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14769)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:02:08.541501 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 21:02:08.569853 run osmo-hlr_10.42.42.2(pid=14766): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14766)] 21:02:08.619536 run osmo-hlr_10.42.42.2(pid=14766): stdout: | (launched: 2022-12-09_21:02:05.205081) 21:02:08.670853 run osmo-hlr_10.42.42.2(pid=14766): stderr: | 20221209210205403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210205403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210205403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210205403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210205403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210205403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210205416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210205424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210205424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210205425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:08.722838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14759): Terminating (SIGTERM) 21:02:08.764447 run iperf3-srv_10.42.42.10(pid=14760): Terminating (SIGTERM) 21:02:08.805914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14761): Terminating (SIGTERM) 21:02:08.847491 run iperf3-srv_10.42.42.10(pid=14762): Terminating (SIGTERM) 21:02:08.889083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14765): Terminating (SIGTERM) 21:02:08.930666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14768): Terminating (SIGTERM) 21:02:08.972587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14771): Terminating (SIGTERM) 21:02:09.014681 --- ParallelTerminationStrategy: PID 14759 died... 21:02:09.034145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14759): Terminated: ok {rc=0} 21:02:09.080114 --- ParallelTerminationStrategy: PID 14760 died... 21:02:09.099528 run iperf3-srv_10.42.42.10(pid=14760): Terminated {rc=256} 21:02:09.145068 --- ParallelTerminationStrategy: PID 14761 died... 21:02:09.164356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14761): Terminated: ok {rc=0} 21:02:09.209874 --- ParallelTerminationStrategy: PID 14762 died... 21:02:09.229272 run iperf3-srv_10.42.42.10(pid=14762): Terminated {rc=256} 21:02:09.274689 --- ParallelTerminationStrategy: PID 14765 died... 21:02:09.294022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14765): Terminated: ok {rc=0} 21:02:09.339563 --- ParallelTerminationStrategy: PID 14768 died... 21:02:09.359000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14768): Terminated: ok {rc=0} 21:02:09.405351 --- ParallelTerminationStrategy: PID 14771 died... 21:02:09.424786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14771): Terminated: ok {rc=0} 21:02:09.512133 bus /gobi_0: Setting Powered False 21:02:10.610975 bus /gobi_0: Setting Powered False 21:02:11.725543 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:02:12.873493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:12.885710 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:12.933697 tst iperf3.py: using LAC 23702 21:02:13.061679 tst iperf3.py: using RAC 242 21:02:13.184300 tst iperf3.py: using CellId 23702 21:02:13.305357 tst iperf3.py: using BVCI 23703 21:02:13.416184 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.427444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.438236 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.449497 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.460461 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.471921 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.483222 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.494394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:13.505708 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:13.624625 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:13.841319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:14.164746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Launched 21:02:14.444241 run iperf3-srv_10.42.42.10(pid=14774): Launched 21:02:14.564398 tst iperf3.py:8: start network... 21:02:14.781174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:15.279214 run create_hlr_db(pid=14775): Launched 21:02:15.411377 bus /gobi_6: Setting Powered False 21:02:16.476928 run create_hlr_db(pid=14775): Terminated: ok {rc=0} 21:02:16.945372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Launched 21:02:17.269404 run osmo-hlr_10.42.42.2(pid=14778): Launched 21:02:17.384595 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:17.917117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Launched 21:02:18.218554 run osmo-stp_10.42.42.5(pid=14781): Launched 21:02:18.334744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:18.852569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Launched 21:02:18.967550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:19.222004 run patchelf(pid=14784): Launched 21:02:19.390446 run osmo-stp_10.42.42.5(pid=14781): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] 21:02:19.517961 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-09_21:02:18.163017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:19.647172 run osmo-stp_10.42.42.5(pid=14781): stderr: | 20221209210218332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210218332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210218332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210218333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210218333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210218333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210218333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:19.776580 run osmo-stp_10.42.42.5(pid=14781): stdout: | (launched: 2022-12-09_21:02:18.163017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:19.900107 run osmo-stp_10.42.42.5(pid=14781): stderr: | 20221209210218332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210218332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210218332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210218333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210218333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210218333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210218333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:20.046823 run patchelf(pid=14784): Terminating (SIGINT) 21:02:20.216588 run patchelf(pid=14784): Terminated: ok {rc=0} 21:02:20.339196 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 21:02:20.348800 tst iperf3.py:8: Test FAILED (7.5 sec) 21:02:20.376462 run osmo-hlr_10.42.42.2(pid=14778): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14778)] 21:02:20.424151 run osmo-hlr_10.42.42.2(pid=14778): stdout: | (launched: 2022-12-09_21:02:17.213286) 21:02:20.473595 run osmo-hlr_10.42.42.2(pid=14778): stderr: | 20221209210217386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210217386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210217386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210217386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210217386 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210217386 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210217399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210217409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210217410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210217410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:20.523601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Terminating (SIGTERM) 21:02:20.563138 run iperf3-srv_10.42.42.10(pid=14774): Terminating (SIGTERM) 21:02:20.602830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminating (SIGTERM) 21:02:20.642480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminating (SIGTERM) 21:02:20.681982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminating (SIGTERM) 21:02:20.721674 --- ParallelTerminationStrategy: PID 14773 died... 21:02:20.740586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14773): Terminated: ok {rc=0} 21:02:20.784496 --- ParallelTerminationStrategy: PID 14774 died... 21:02:20.802642 run iperf3-srv_10.42.42.10(pid=14774): Terminated {rc=256} 21:02:20.846099 --- ParallelTerminationStrategy: PID 14777 died... 21:02:20.864476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14777): Terminated: ok {rc=0} 21:02:20.907935 --- ParallelTerminationStrategy: PID 14780 died... 21:02:20.926251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14780): Terminated: ok {rc=0} 21:02:20.970365 --- ParallelTerminationStrategy: PID 14783 died... 21:02:20.989207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14783): Terminated: ok {rc=0} 21:02:21.074929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:02:22.220838 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.232675 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:22.286537 tst iperf3m4.py: using LAC 23703 21:02:22.404073 tst iperf3m4.py: using RAC 243 21:02:22.520533 tst iperf3m4.py: using CellId 23703 21:02:22.636792 tst iperf3m4.py: using BVCI 23704 21:02:22.745860 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.756881 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.767647 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.778975 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.790233 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.801535 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.812669 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.823817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:22.835445 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:22.957644 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:23.077106 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:23.195761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:23.314143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:02:23.515943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:23.818933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Launched 21:02:24.081215 run iperf3-srv_10.42.42.10(pid=14786): Launched 21:02:24.194225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:02:24.396942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:24.699305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Launched 21:02:24.960928 run iperf3-srv_10.42.42.10(pid=14788): Launched 21:02:25.073654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:02:25.275681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:25.579942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Launched 21:02:25.842588 run iperf3-srv_10.42.42.10(pid=14790): Launched 21:02:25.957273 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:02:26.159677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:02:26.462998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14791): Launched 21:02:26.727615 run iperf3-srv_10.42.42.10(pid=14792): Launched 21:02:26.840269 tst iperf3m4.py:8: start network... 21:02:27.042234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:27.510601 run create_hlr_db(pid=14793): Launched 21:02:27.626324 bus /gobi_6: Setting Powered False 21:02:28.690035 run create_hlr_db(pid=14793): Terminated: ok {rc=0} 21:02:29.139987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14795): Launched 21:02:29.462859 run osmo-hlr_10.42.42.2(pid=14796): Launched 21:02:29.586479 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:30.143932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14798): Launched 21:02:30.467829 run osmo-stp_10.42.42.5(pid=14799): Launched 21:02:30.591205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:31.169720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14801): Launched 21:02:31.292528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:31.557958 run patchelf(pid=14802): Launched 21:02:31.769259 run osmo-stp_10.42.42.5(pid=14799): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14799)] 21:02:31.903206 run osmo-stp_10.42.42.5(pid=14799): stdout: | (launched: 2022-12-09_21:02:30.408433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:32.037355 run osmo-stp_10.42.42.5(pid=14799): stderr: | 20221209210230596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210230596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210230597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210230597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210230598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210230598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210230598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:32.171271 run osmo-stp_10.42.42.5(pid=14799): stdout: | (launched: 2022-12-09_21:02:30.408433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:32.299403 run osmo-stp_10.42.42.5(pid=14799): stderr: | 20221209210230596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210230596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210230597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210230597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210230598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210230598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210230598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:32.446122 run patchelf(pid=14802): Terminating (SIGINT) 21:02:32.615697 run patchelf(pid=14802): Terminated: ok {rc=0} 21:02:32.738346 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14799): Process ended prematurely: osmo-stp_10.42.42.5(pid=14799) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14799)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 21:02:32.748400 tst iperf3m4.py:8: Test FAILED (10.6 sec) 21:02:32.776687 run osmo-hlr_10.42.42.2(pid=14796): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14796)] 21:02:32.824831 run osmo-hlr_10.42.42.2(pid=14796): stdout: | (launched: 2022-12-09_21:02:29.403708) 21:02:32.874532 run osmo-hlr_10.42.42.2(pid=14796): stderr: | 20221209210229600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210229600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210229600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210229600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210229600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210229601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210229613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210229623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210229623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210229623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:32.924608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminating (SIGTERM) 21:02:32.964152 run iperf3-srv_10.42.42.10(pid=14786): Terminating (SIGTERM) 21:02:33.003730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Terminating (SIGTERM) 21:02:33.043293 run iperf3-srv_10.42.42.10(pid=14788): Terminating (SIGTERM) 21:02:33.082750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Terminating (SIGTERM) 21:02:33.122355 run iperf3-srv_10.42.42.10(pid=14790): Terminating (SIGTERM) 21:02:33.161705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14791): Terminating (SIGTERM) 21:02:33.201330 run iperf3-srv_10.42.42.10(pid=14792): Terminating (SIGTERM) 21:02:33.240691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14795): Terminating (SIGTERM) 21:02:33.280188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14798): Terminating (SIGTERM) 21:02:33.319668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14801): Terminating (SIGTERM) 21:02:33.359437 --- ParallelTerminationStrategy: PID 14785 died... 21:02:33.377956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14785): Terminated: ok {rc=0} 21:02:33.421657 --- ParallelTerminationStrategy: PID 14786 died... 21:02:33.440292 run iperf3-srv_10.42.42.10(pid=14786): Terminated {rc=256} 21:02:33.484140 --- ParallelTerminationStrategy: PID 14787 died... 21:02:33.502523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14787): Terminated: ok {rc=0} 21:02:33.546213 --- ParallelTerminationStrategy: PID 14788 died... 21:02:33.564483 run iperf3-srv_10.42.42.10(pid=14788): Terminated {rc=256} 21:02:33.608195 --- ParallelTerminationStrategy: PID 14789 died... 21:02:33.626593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14789): Terminated: ok {rc=0} 21:02:33.670844 --- ParallelTerminationStrategy: PID 14790 died... 21:02:33.689234 run iperf3-srv_10.42.42.10(pid=14790): Terminated {rc=256} 21:02:33.733271 --- ParallelTerminationStrategy: PID 14791 died... 21:02:33.751819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14791): Terminated: ok {rc=0} 21:02:33.796147 --- ParallelTerminationStrategy: PID 14792 died... 21:02:33.814573 run iperf3-srv_10.42.42.10(pid=14792): Terminated {rc=256} 21:02:33.858740 --- ParallelTerminationStrategy: PID 14795 died... 21:02:33.877316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14795): Terminated: ok {rc=0} 21:02:33.921724 --- ParallelTerminationStrategy: PID 14798 died... 21:02:33.940284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14798): Terminated: ok {rc=0} 21:02:33.984513 --- ParallelTerminationStrategy: PID 14801 died... 21:02:34.003244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14801): Terminated: ok {rc=0} 21:02:34.086932 bus /gobi_4: Setting Powered False 21:02:35.185255 bus /gobi_4: Setting Powered False 21:02:36.300076 bus /gobi_1: Setting Powered False 21:02:37.397787 bus /gobi_1: Setting Powered False 21:02:38.511997 bus /gobi_0: Setting Powered False 21:02:39.609745 bus /gobi_0: Setting Powered False 21:02:40.725562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 21:02:41.828543 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:41.840841 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:41.889034 tst ping.py: using LAC 23704 21:02:42.012910 tst ping.py: using RAC 244 21:02:42.136688 tst ping.py: using CellId 23704 21:02:42.260579 tst ping.py: using BVCI 23705 21:02:42.377484 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.389214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.400701 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.412213 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.423620 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.434889 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.446451 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:42.458011 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:42.576577 tst ping.py:19: start network... 21:02:42.789083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:43.277392 run create_hlr_db(pid=14805): Launched 21:02:43.404583 bus /gobi_6: Setting Powered False 21:02:44.467393 run create_hlr_db(pid=14805): Terminated: ok {rc=0} 21:02:44.889632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Launched 21:02:45.206226 run osmo-hlr_10.42.42.2(pid=14808): Launched 21:02:45.326951 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:45.878105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Launched 21:02:46.212657 run osmo-stp_10.42.42.5(pid=14811): Launched 21:02:46.446960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:47.105678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Launched 21:02:47.235606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:47.486453 run patchelf(pid=14814): Launched 21:02:47.652890 run osmo-stp_10.42.42.5(pid=14811): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] 21:02:47.778910 run osmo-stp_10.42.42.5(pid=14811): stdout: | (launched: 2022-12-09_21:02:46.156657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:47.906961 run osmo-stp_10.42.42.5(pid=14811): stderr: | 20221209210246468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210246468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210246468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210246470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210246470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210246470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210246470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:48.034495 run osmo-stp_10.42.42.5(pid=14811): stdout: | (launched: 2022-12-09_21:02:46.156657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:48.155994 run osmo-stp_10.42.42.5(pid=14811): stderr: | 20221209210246468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210246468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210246468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210246470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210246470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210246470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210246470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:48.299909 run patchelf(pid=14814): Terminating (SIGINT) 21:02:48.467389 run patchelf(pid=14814): Terminated: ok {rc=0} 21:02:48.587740 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14811): Process ended prematurely: osmo-stp_10.42.42.5(pid=14811) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 21:02:48.596882 tst ping.py:22: Test FAILED (6.8 sec) 21:02:48.623985 run osmo-hlr_10.42.42.2(pid=14808): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14808)] 21:02:48.671424 run osmo-hlr_10.42.42.2(pid=14808): stdout: | (launched: 2022-12-09_21:02:45.148532) 21:02:48.721106 run osmo-hlr_10.42.42.2(pid=14808): stderr: | 20221209210245345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210245345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210245345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210245345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210245345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210245345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210245361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210245371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210245371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210245371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:48.770883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminating (SIGTERM) 21:02:48.810621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Terminating (SIGTERM) 21:02:48.850303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Terminating (SIGTERM) 21:02:48.890313 --- ParallelTerminationStrategy: PID 14807 died... 21:02:48.909257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14807): Terminated: ok {rc=0} 21:02:48.953097 --- ParallelTerminationStrategy: PID 14810 died... 21:02:48.971881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14810): Terminated: ok {rc=0} 21:02:49.015779 --- ParallelTerminationStrategy: PID 14813 died... 21:02:49.034441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14813): Terminated: ok {rc=0} 21:02:49.119802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:02:50.208635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.220836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:02:50.268133 tst ping_idle_ping.py: using LAC 23705 21:02:50.387286 tst ping_idle_ping.py: using RAC 245 21:02:50.505901 tst ping_idle_ping.py: using CellId 23705 21:02:50.628010 tst ping_idle_ping.py: using BVCI 23706 21:02:50.737067 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.748122 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.758982 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.770110 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.781071 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.791919 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.803035 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:02:50.814081 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:02:50.927821 tst ping_idle_ping.py:24: start network... 21:02:51.126834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:02:51.588778 run create_hlr_db(pid=14815): Launched 21:02:51.701721 bus /gobi_6: Setting Powered False 21:02:52.761310 run create_hlr_db(pid=14815): Terminated: ok {rc=0} 21:02:53.197344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Launched 21:02:53.514081 run osmo-hlr_10.42.42.2(pid=14818): Launched 21:02:53.636351 run osmo-stp_10.42.42.5: Starting osmo-stp 21:02:54.181427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Launched 21:02:54.500195 run osmo-stp_10.42.42.5(pid=14821): Launched 21:02:54.621649 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:02:55.169413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Launched 21:02:55.289797 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:02:55.558303 run patchelf(pid=14824): Launched 21:02:55.735878 run osmo-stp_10.42.42.5(pid=14821): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] 21:02:55.870271 run osmo-stp_10.42.42.5(pid=14821): stdout: | (launched: 2022-12-09_21:02:54.441020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:56.006985 run osmo-stp_10.42.42.5(pid=14821): stderr: | 20221209210254633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210254633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210254633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210254634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210254634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210254634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210254634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:56.143334 run osmo-stp_10.42.42.5(pid=14821): stdout: | (launched: 2022-12-09_21:02:54.441020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:02:56.273341 run osmo-stp_10.42.42.5(pid=14821): stderr: | 20221209210254633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210254633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210254633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210254634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210254634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210254634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210254634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:02:56.427345 run patchelf(pid=14824): Terminating (SIGINT) 21:02:56.605518 run patchelf(pid=14824): Terminated: ok {rc=0} 21:02:56.733131 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14821): Process ended prematurely: osmo-stp_10.42.42.5(pid=14821) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 21:02:56.742996 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:02:56.771182 run osmo-hlr_10.42.42.2(pid=14818): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14818)] 21:02:56.821400 run osmo-hlr_10.42.42.2(pid=14818): stdout: | (launched: 2022-12-09_21:02:53.456176) 21:02:56.873186 run osmo-hlr_10.42.42.2(pid=14818): stderr: | 20221209210253651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210253651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210253652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210253652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210253652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210253652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210253664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210253672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210253673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210253673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:02:56.925214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Terminating (SIGTERM) 21:02:56.967299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Terminating (SIGTERM) 21:02:57.009096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Terminating (SIGTERM) 21:02:57.051180 --- ParallelTerminationStrategy: PID 14817 died... 21:02:57.071035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14817): Terminated: ok {rc=0} 21:02:57.116915 --- ParallelTerminationStrategy: PID 14820 died... 21:02:57.136460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14820): Terminated: ok {rc=0} 21:02:57.182013 --- ParallelTerminationStrategy: PID 14823 died... 21:02:57.201514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14823): Terminated: ok {rc=0} 21:02:57.288859 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:02:58.591581 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:02:58.598045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:02:58.628492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:02:58.667953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:02:58.757989 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:02:58.788324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:02:58.827727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:02:59.425817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:02:59.477727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:02:59.489353 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:02:59.556116 tst cs_paging_gprs_active.py: using LAC 23706 21:02:59.681531 tst cs_paging_gprs_active.py: using RAC 246 21:02:59.809039 tst cs_paging_gprs_active.py: using CellId 23706 21:02:59.934795 tst cs_paging_gprs_active.py: using BVCI 23707 21:03:00.053558 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.065003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.076394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.087724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.099027 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.110250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.121645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.132737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:00.144078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:00.260528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:00.376662 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:03:00.580740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:00.884234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14828): Launched 21:03:01.175481 run iperf3-srv_10.42.42.10(pid=14830): Launched 21:03:01.295751 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:03:01.503824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:01.815146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14831): Launched 21:03:02.148907 run iperf3-srv_10.42.42.10(pid=14832): Launched 21:03:02.280290 tst cs_paging_gprs_active.py:38: start network... 21:03:02.486573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:02.957172 run create_hlr_db(pid=14833): Launched 21:03:03.073331 bus /gobi_6: Setting Powered False 21:03:04.133996 run create_hlr_db(pid=14833): Terminated: ok {rc=0} 21:03:04.575987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14835): Launched 21:03:04.899401 run osmo-hlr_10.42.42.2(pid=14836): Launched 21:03:05.022216 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:05.576025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14838): Launched 21:03:05.898492 run osmo-stp_10.42.42.5(pid=14839): Launched 21:03:06.021046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:06.577533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14841): Launched 21:03:06.701247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:06.974634 run patchelf(pid=14842): Launched 21:03:07.155429 run osmo-stp_10.42.42.5(pid=14839): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14839)] 21:03:07.292490 run osmo-stp_10.42.42.5(pid=14839): stdout: | (launched: 2022-12-09_21:03:05.839523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:07.431097 run osmo-stp_10.42.42.5(pid=14839): stderr: | 20221209210306029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210306029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210306030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210306030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210306030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210306030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210306030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:07.569670 run osmo-stp_10.42.42.5(pid=14839): stdout: | (launched: 2022-12-09_21:03:05.839523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:07.702197 run osmo-stp_10.42.42.5(pid=14839): stderr: | 20221209210306029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210306029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210306030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210306030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210306030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210306030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210306030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:07.859272 run patchelf(pid=14842): Terminating (SIGINT) 21:03:08.041269 run patchelf(pid=14842): Terminated: ok {rc=0} 21:03:08.172194 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14839): Process ended prematurely: osmo-stp_10.42.42.5(pid=14839) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14839)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:03:08.182753 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:03:08.211401 run osmo-hlr_10.42.42.2(pid=14836): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14836)] 21:03:08.261527 run osmo-hlr_10.42.42.2(pid=14836): stdout: | (launched: 2022-12-09_21:03:04.840098) 21:03:08.313324 run osmo-hlr_10.42.42.2(pid=14836): stderr: | 20221209210305038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210305038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210305039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210305039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210305039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210305039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210305050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210305058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210305058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210305058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:08.365798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14828): Terminating (SIGTERM) 21:03:08.407518 run iperf3-srv_10.42.42.10(pid=14830): Terminating (SIGTERM) 21:03:08.449031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14831): Terminating (SIGTERM) 21:03:08.490696 run iperf3-srv_10.42.42.10(pid=14832): Terminating (SIGTERM) 21:03:08.532154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14835): Terminating (SIGTERM) 21:03:08.574257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14838): Terminating (SIGTERM) 21:03:08.616029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14841): Terminating (SIGTERM) 21:03:08.657952 --- ParallelTerminationStrategy: PID 14828 died... 21:03:08.677855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14828): Terminated: ok {rc=0} 21:03:08.724255 --- ParallelTerminationStrategy: PID 14830 died... 21:03:08.743716 run iperf3-srv_10.42.42.10(pid=14830): Terminated {rc=256} 21:03:08.789757 --- ParallelTerminationStrategy: PID 14831 died... 21:03:08.809335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14831): Terminated: ok {rc=0} 21:03:08.855209 --- ParallelTerminationStrategy: PID 14832 died... 21:03:08.874916 run iperf3-srv_10.42.42.10(pid=14832): Terminated {rc=256} 21:03:08.921042 --- ParallelTerminationStrategy: PID 14835 died... 21:03:08.940509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14835): Terminated: ok {rc=0} 21:03:08.986768 --- ParallelTerminationStrategy: PID 14838 died... 21:03:09.006290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14838): Terminated: ok {rc=0} 21:03:09.052125 --- ParallelTerminationStrategy: PID 14841 died... 21:03:09.071737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14841): Terminated: ok {rc=0} 21:03:09.158949 bus /gobi_0: Setting Powered False 21:03:10.256677 bus /gobi_0: Setting Powered False 21:03:11.372707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:03:12.517902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:12.529890 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:12.597558 tst iperf3.py: using LAC 23707 21:03:12.717438 tst iperf3.py: using RAC 247 21:03:12.845511 tst iperf3.py: using CellId 23707 21:03:12.972410 tst iperf3.py: using BVCI 23708 21:03:13.083375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.094652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.105695 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.116686 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.127850 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.138934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.150302 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.161406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:13.172458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:13.293535 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:03:13.512500 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:13.837069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Launched 21:03:14.118346 run iperf3-srv_10.42.42.10(pid=14844): Launched 21:03:14.240816 tst iperf3.py:8: start network... 21:03:14.458856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:14.931645 run create_hlr_db(pid=14845): Launched 21:03:15.047016 bus /gobi_6: Setting Powered False 21:03:16.104368 run create_hlr_db(pid=14845): Terminated: ok {rc=0} 21:03:16.532507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Launched 21:03:16.856181 run osmo-hlr_10.42.42.2(pid=14848): Launched 21:03:17.158482 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:17.743940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Launched 21:03:18.066786 run osmo-stp_10.42.42.5(pid=14851): Launched 21:03:18.189282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:18.749207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Launched 21:03:18.871725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:19.145780 run patchelf(pid=14854): Launched 21:03:19.325597 run osmo-stp_10.42.42.5(pid=14851): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] 21:03:19.462616 run osmo-stp_10.42.42.5(pid=14851): stdout: | (launched: 2022-12-09_21:03:18.007809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:19.601220 run osmo-stp_10.42.42.5(pid=14851): stderr: | 20221209210318199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210318199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210318200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210318200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210318201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210318201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210318201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:19.739234 run osmo-stp_10.42.42.5(pid=14851): stdout: | (launched: 2022-12-09_21:03:18.007809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:19.871685 run osmo-stp_10.42.42.5(pid=14851): stderr: | 20221209210318199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210318199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210318200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210318200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210318201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210318201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210318201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:20.029061 run patchelf(pid=14854): Terminating (SIGINT) 21:03:20.209927 run patchelf(pid=14854): Terminated: ok {rc=0} 21:03:20.340497 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14851): Process ended prematurely: osmo-stp_10.42.42.5(pid=14851) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 21:03:20.350968 tst iperf3.py:8: Test FAILED (7.9 sec) 21:03:20.379501 run osmo-hlr_10.42.42.2(pid=14848): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14848)] 21:03:20.429332 run osmo-hlr_10.42.42.2(pid=14848): stdout: | (launched: 2022-12-09_21:03:16.796923) 21:03:20.480847 run osmo-hlr_10.42.42.2(pid=14848): stderr: | 20221209210317098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210317098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210317098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210317098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210317098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210317099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210317121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210317140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210317140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210317140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:20.533058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Terminating (SIGTERM) 21:03:20.574618 run iperf3-srv_10.42.42.10(pid=14844): Terminating (SIGTERM) 21:03:20.616199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Terminating (SIGTERM) 21:03:20.658136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Terminating (SIGTERM) 21:03:20.700131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Terminating (SIGTERM) 21:03:20.742083 --- ParallelTerminationStrategy: PID 14843 died... 21:03:20.761954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14843): Terminated: ok {rc=0} 21:03:20.807992 --- ParallelTerminationStrategy: PID 14844 died... 21:03:20.827445 run iperf3-srv_10.42.42.10(pid=14844): Terminated {rc=256} 21:03:20.873299 --- ParallelTerminationStrategy: PID 14847 died... 21:03:20.892708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14847): Terminated: ok {rc=0} 21:03:20.938307 --- ParallelTerminationStrategy: PID 14850 died... 21:03:20.958148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14850): Terminated: ok {rc=0} 21:03:21.004152 --- ParallelTerminationStrategy: PID 14853 died... 21:03:21.023518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14853): Terminated: ok {rc=0} 21:03:21.110788 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:03:22.261031 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.273470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:22.340900 tst iperf3m4.py: using LAC 23708 21:03:22.468384 tst iperf3m4.py: using RAC 248 21:03:22.593944 tst iperf3m4.py: using CellId 23708 21:03:22.720757 tst iperf3m4.py: using BVCI 23709 21:03:22.837958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.849663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.861281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.872763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.884199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.895644 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.907245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.918624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:22.930527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:23.048549 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:23.169985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:23.289949 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:23.407607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:03:23.625692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:23.949459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Launched 21:03:24.230873 run iperf3-srv_10.42.42.10(pid=14856): Launched 21:03:24.351644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:03:24.569452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:24.893861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Launched 21:03:25.176244 run iperf3-srv_10.42.42.10(pid=14858): Launched 21:03:25.296838 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:03:25.514310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:25.837661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14859): Launched 21:03:26.119603 run iperf3-srv_10.42.42.10(pid=14860): Launched 21:03:26.239986 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:03:26.457053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:03:26.781573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14861): Launched 21:03:27.061770 run iperf3-srv_10.42.42.10(pid=14862): Launched 21:03:27.181635 tst iperf3m4.py:8: start network... 21:03:27.398152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:27.897234 run create_hlr_db(pid=14863): Launched 21:03:28.029128 bus /gobi_6: Setting Powered False 21:03:29.089361 run create_hlr_db(pid=14863): Terminated: ok {rc=0} 21:03:29.537867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14865): Launched 21:03:29.861037 run osmo-hlr_10.42.42.2(pid=14866): Launched 21:03:29.983625 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:30.540232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14868): Launched 21:03:30.870833 run osmo-stp_10.42.42.5(pid=14869): Launched 21:03:31.031786 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:31.763614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14871): Launched 21:03:31.898884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:32.166670 run patchelf(pid=14872): Launched 21:03:32.348113 run osmo-stp_10.42.42.5(pid=14869): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14869)] 21:03:32.476798 run osmo-stp_10.42.42.5(pid=14869): stdout: | (launched: 2022-12-09_21:03:30.804242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:32.606471 run osmo-stp_10.42.42.5(pid=14869): stderr: | 20221209210331128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210331128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210331129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210331130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210331130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210331130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210331130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:32.736175 run osmo-stp_10.42.42.5(pid=14869): stdout: | (launched: 2022-12-09_21:03:30.804242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:32.861206 run osmo-stp_10.42.42.5(pid=14869): stderr: | 20221209210331128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210331128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210331129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210331130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210331130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210331130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210331130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:33.008109 run patchelf(pid=14872): Terminating (SIGINT) 21:03:33.178110 run patchelf(pid=14872): Terminated: ok {rc=0} 21:03:33.300932 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14869): Process ended prematurely: osmo-stp_10.42.42.5(pid=14869) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14869)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:03:33.310838 tst iperf3m4.py:8: Test FAILED (11.1 sec) 21:03:33.338577 run osmo-hlr_10.42.42.2(pid=14866): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14866)] 21:03:33.386862 run osmo-hlr_10.42.42.2(pid=14866): stdout: | (launched: 2022-12-09_21:03:29.800099) 21:03:33.436322 run osmo-hlr_10.42.42.2(pid=14866): stderr: | 20221209210329998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210329999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210329999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210329999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210329999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210329999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210330011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210330020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210330020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210330020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:33.486357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminating (SIGTERM) 21:03:33.526255 run iperf3-srv_10.42.42.10(pid=14856): Terminating (SIGTERM) 21:03:33.566115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Terminating (SIGTERM) 21:03:33.606022 run iperf3-srv_10.42.42.10(pid=14858): Terminating (SIGTERM) 21:03:33.645837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14859): Terminating (SIGTERM) 21:03:33.685844 run iperf3-srv_10.42.42.10(pid=14860): Terminating (SIGTERM) 21:03:33.725664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14861): Terminating (SIGTERM) 21:03:33.765579 run iperf3-srv_10.42.42.10(pid=14862): Terminating (SIGTERM) 21:03:33.805428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14865): Terminating (SIGTERM) 21:03:33.845232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14868): Terminating (SIGTERM) 21:03:33.885120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14871): Terminating (SIGTERM) 21:03:33.925629 --- ParallelTerminationStrategy: PID 14855 died... 21:03:33.944470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminated: ok {rc=0} 21:03:33.988578 --- ParallelTerminationStrategy: PID 14856 died... 21:03:34.007195 run iperf3-srv_10.42.42.10(pid=14856): Terminated {rc=256} 21:03:34.051068 --- ParallelTerminationStrategy: PID 14857 died... 21:03:34.069633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14857): Terminated: ok {rc=0} 21:03:34.113630 --- ParallelTerminationStrategy: PID 14858 died... 21:03:34.132301 run iperf3-srv_10.42.42.10(pid=14858): Terminated {rc=256} 21:03:34.176354 --- ParallelTerminationStrategy: PID 14859 died... 21:03:34.195012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14859): Terminated: ok {rc=0} 21:03:34.238984 --- ParallelTerminationStrategy: PID 14860 died... 21:03:34.257621 run iperf3-srv_10.42.42.10(pid=14860): Terminated {rc=256} 21:03:34.301965 --- ParallelTerminationStrategy: PID 14861 died... 21:03:34.320576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14861): Terminated: ok {rc=0} 21:03:34.364822 --- ParallelTerminationStrategy: PID 14862 died... 21:03:34.383796 run iperf3-srv_10.42.42.10(pid=14862): Terminated {rc=256} 21:03:34.427644 --- ParallelTerminationStrategy: PID 14865 died... 21:03:34.446283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14865): Terminated: ok {rc=0} 21:03:34.490318 --- ParallelTerminationStrategy: PID 14868 died... 21:03:34.509035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14868): Terminated: ok {rc=0} 21:03:34.553660 --- ParallelTerminationStrategy: PID 14871 died... 21:03:34.572121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14871): Terminated: ok {rc=0} 21:03:34.658582 bus /gobi_4: Setting Powered False 21:03:35.759062 bus /gobi_4: Setting Powered False 21:03:36.873961 bus /gobi_1: Setting Powered False 21:03:37.970148 bus /gobi_1: Setting Powered False 21:03:39.085280 bus /gobi_0: Setting Powered False 21:03:40.182393 bus /gobi_0: Setting Powered False 21:03:41.296624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:03:42.396775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:42.409345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:42.477015 tst ping.py: using LAC 23709 21:03:42.601456 tst ping.py: using RAC 249 21:03:42.720136 tst ping.py: using CellId 23709 21:03:42.839010 tst ping.py: using BVCI 23710 21:03:42.948939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:42.960161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:42.971110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:42.982701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:42.994335 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:43.006009 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:43.017964 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:43.029752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:43.147036 tst ping.py:19: start network... 21:03:43.346287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:43.806095 run create_hlr_db(pid=14873): Launched 21:03:43.920782 bus /gobi_6: Setting Powered False 21:03:44.980419 run create_hlr_db(pid=14873): Terminated: ok {rc=0} 21:03:45.415170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14875): Launched 21:03:45.731562 run osmo-hlr_10.42.42.2(pid=14876): Launched 21:03:45.894328 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:46.611008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14878): Launched 21:03:46.931970 run osmo-stp_10.42.42.5(pid=14879): Launched 21:03:47.099577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:47.726825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14881): Launched 21:03:47.840446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:48.092060 run patchelf(pid=14882): Launched 21:03:48.256694 run osmo-stp_10.42.42.5(pid=14879): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14879)] 21:03:48.381947 run osmo-stp_10.42.42.5(pid=14879): stdout: | (launched: 2022-12-09_21:03:46.876446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:48.509346 run osmo-stp_10.42.42.5(pid=14879): stderr: | 20221209210347154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210347154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210347154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210347155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210347155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210347155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210347155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:48.636776 run osmo-stp_10.42.42.5(pid=14879): stdout: | (launched: 2022-12-09_21:03:46.876446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:48.758541 run osmo-stp_10.42.42.5(pid=14879): stderr: | 20221209210347154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210347154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210347154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210347155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210347155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210347155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210347155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:48.903241 run patchelf(pid=14882): Terminating (SIGINT) 21:03:49.070227 run patchelf(pid=14882): Terminated: ok {rc=0} 21:03:49.190415 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14879): Process ended prematurely: osmo-stp_10.42.42.5(pid=14879) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14879)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 21:03:49.199371 tst ping.py:22: Test FAILED (6.8 sec) 21:03:49.226216 run osmo-hlr_10.42.42.2(pid=14876): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14876)] 21:03:49.273843 run osmo-hlr_10.42.42.2(pid=14876): stdout: | (launched: 2022-12-09_21:03:45.673745) 21:03:49.323014 run osmo-hlr_10.42.42.2(pid=14876): stderr: | 20221209210345919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210345919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210345920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210345920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210345920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210345920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210345940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210345957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210345957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210345957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:49.372647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14875): Terminating (SIGTERM) 21:03:49.412096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14878): Terminating (SIGTERM) 21:03:49.451557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14881): Terminating (SIGTERM) 21:03:49.491165 --- ParallelTerminationStrategy: PID 14875 died... 21:03:49.510019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14875): Terminated: ok {rc=0} 21:03:49.554127 --- ParallelTerminationStrategy: PID 14878 died... 21:03:49.572522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14878): Terminated: ok {rc=0} 21:03:49.616147 --- ParallelTerminationStrategy: PID 14881 died... 21:03:49.634629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14881): Terminated: ok {rc=0} 21:03:49.717586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:03:50.803961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:50.816285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:03:50.885022 tst ping_idle_ping.py: using LAC 23710 21:03:51.009828 tst ping_idle_ping.py: using RAC 250 21:03:51.135939 tst ping_idle_ping.py: using CellId 23710 21:03:51.262314 tst ping_idle_ping.py: using BVCI 23711 21:03:51.379196 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.390712 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.402049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.413407 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.424685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.436052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.447402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:03:51.458741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:03:51.572819 tst ping_idle_ping.py:24: start network... 21:03:51.771346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:03:52.234641 run create_hlr_db(pid=14883): Launched 21:03:52.350590 bus /gobi_6: Setting Powered False 21:03:53.410672 run create_hlr_db(pid=14883): Terminated: ok {rc=0} 21:03:53.846399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14885): Launched 21:03:54.165081 run osmo-hlr_10.42.42.2(pid=14886): Launched 21:03:54.286140 run osmo-stp_10.42.42.5: Starting osmo-stp 21:03:54.832905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14888): Launched 21:03:55.152795 run osmo-stp_10.42.42.5(pid=14889): Launched 21:03:55.274153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:03:55.825437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14891): Launched 21:03:55.946499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:03:56.215468 run patchelf(pid=14892): Launched 21:03:56.392920 run osmo-stp_10.42.42.5(pid=14889): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14889)] 21:03:56.527515 run osmo-stp_10.42.42.5(pid=14889): stdout: | (launched: 2022-12-09_21:03:55.094561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:56.663843 run osmo-stp_10.42.42.5(pid=14889): stderr: | 20221209210355285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210355285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210355286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210355286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210355287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210355287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210355287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:56.800107 run osmo-stp_10.42.42.5(pid=14889): stdout: | (launched: 2022-12-09_21:03:55.094561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:03:56.930651 run osmo-stp_10.42.42.5(pid=14889): stderr: | 20221209210355285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210355285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210355286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210355286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210355287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210355287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210355287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:03:57.086187 run patchelf(pid=14892): Terminating (SIGINT) 21:03:57.264165 run patchelf(pid=14892): Terminated: ok {rc=0} 21:03:57.392648 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14889): Process ended prematurely: osmo-stp_10.42.42.5(pid=14889) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14889)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:03:57.402599 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 21:03:57.430745 run osmo-hlr_10.42.42.2(pid=14886): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14886)] 21:03:57.480321 run osmo-hlr_10.42.42.2(pid=14886): stdout: | (launched: 2022-12-09_21:03:54.106789) 21:03:57.531751 run osmo-hlr_10.42.42.2(pid=14886): stderr: | 20221209210354303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210354304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210354304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210354304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210354304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210354304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210354316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210354324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210354324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210354324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:03:57.583687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14885): Terminating (SIGTERM) 21:03:57.625156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14888): Terminating (SIGTERM) 21:03:57.666699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14891): Terminating (SIGTERM) 21:03:57.708558 --- ParallelTerminationStrategy: PID 14885 died... 21:03:57.728469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14885): Terminated: ok {rc=0} 21:03:57.774185 --- ParallelTerminationStrategy: PID 14888 died... 21:03:57.793627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14888): Terminated: ok {rc=0} 21:03:57.838993 --- ParallelTerminationStrategy: PID 14891 died... 21:03:57.858378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14891): Terminated: ok {rc=0} 21:03:57.944371 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 21:03:59.256358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:03:59.262914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 21:03:59.292751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 21:03:59.332354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 21:03:59.418879 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 21:03:59.448642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 21:03:59.488086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 21:04:00.082425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 21:04:00.131497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.142482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:00.206302 tst cs_paging_gprs_active.py: using LAC 23711 21:04:00.322554 tst cs_paging_gprs_active.py: using RAC 251 21:04:00.444048 tst cs_paging_gprs_active.py: using CellId 23711 21:04:00.564116 tst cs_paging_gprs_active.py: using BVCI 23712 21:04:00.681919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.693474 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.704870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.717113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.729103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.741089 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.753073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.764685 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:00.776623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:00.900568 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:01.033890 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:04:01.247858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:01.562660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14896): Launched 21:04:01.940442 run iperf3-srv_10.42.42.10(pid=14897): Launched 21:04:02.104450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:04:02.338771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:02.664592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14898): Launched 21:04:02.947553 run iperf3-srv_10.42.42.10(pid=14899): Launched 21:04:03.069696 tst cs_paging_gprs_active.py:38: start network... 21:04:03.288471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:03.789872 run create_hlr_db(pid=14900): Launched 21:04:03.921130 bus /gobi_6: Setting Powered False 21:04:04.985141 run create_hlr_db(pid=14900): Terminated: ok {rc=0} 21:04:05.437007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Launched 21:04:05.760253 run osmo-hlr_10.42.42.2(pid=14903): Launched 21:04:05.883402 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:06.441112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Launched 21:04:06.764393 run osmo-stp_10.42.42.5(pid=14906): Launched 21:04:06.887161 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:07.445616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Launched 21:04:07.568286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:07.848721 run patchelf(pid=14909): Launched 21:04:08.029158 run osmo-stp_10.42.42.5(pid=14906): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] 21:04:08.166542 run osmo-stp_10.42.42.5(pid=14906): stdout: | (launched: 2022-12-09_21:04:06.704757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:08.305309 run osmo-stp_10.42.42.5(pid=14906): stderr: | 20221209210406897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210406897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210406897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210406898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210406898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210406898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210406898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:08.443681 run osmo-stp_10.42.42.5(pid=14906): stdout: | (launched: 2022-12-09_21:04:06.704757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:08.576247 run osmo-stp_10.42.42.5(pid=14906): stderr: | 20221209210406897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210406897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210406897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210406898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210406898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210406898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210406898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:08.733724 run patchelf(pid=14909): Terminating (SIGINT) 21:04:08.915765 run patchelf(pid=14909): Terminated: ok {rc=0} 21:04:09.047326 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14906): Process ended prematurely: osmo-stp_10.42.42.5(pid=14906) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 21:04:09.058013 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 21:04:09.086751 run osmo-hlr_10.42.42.2(pid=14903): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14903)] 21:04:09.136542 run osmo-hlr_10.42.42.2(pid=14903): stdout: | (launched: 2022-12-09_21:04:05.701206) 21:04:09.187912 run osmo-hlr_10.42.42.2(pid=14903): stderr: | 20221209210405900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210405900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210405900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210405901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210405901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210405901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210405913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210405921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210405921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210405921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:09.239716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14896): Terminating (SIGTERM) 21:04:09.280897 run iperf3-srv_10.42.42.10(pid=14897): Terminating (SIGTERM) 21:04:09.322414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14898): Terminating (SIGTERM) 21:04:09.363962 run iperf3-srv_10.42.42.10(pid=14899): Terminating (SIGTERM) 21:04:09.405361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Terminating (SIGTERM) 21:04:09.446785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Terminating (SIGTERM) 21:04:09.488148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Terminating (SIGTERM) 21:04:09.530024 --- ParallelTerminationStrategy: PID 14896 died... 21:04:09.549908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14896): Terminated: ok {rc=0} 21:04:09.595873 --- ParallelTerminationStrategy: PID 14897 died... 21:04:09.615114 run iperf3-srv_10.42.42.10(pid=14897): Terminated {rc=256} 21:04:09.660912 --- ParallelTerminationStrategy: PID 14898 died... 21:04:09.680440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14898): Terminated: ok {rc=0} 21:04:09.725942 --- ParallelTerminationStrategy: PID 14899 died... 21:04:09.745286 run iperf3-srv_10.42.42.10(pid=14899): Terminated {rc=256} 21:04:09.790928 --- ParallelTerminationStrategy: PID 14902 died... 21:04:09.810360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14902): Terminated: ok {rc=0} 21:04:09.855898 --- ParallelTerminationStrategy: PID 14905 died... 21:04:09.875233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14905): Terminated: ok {rc=0} 21:04:09.920694 --- ParallelTerminationStrategy: PID 14908 died... 21:04:09.940243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14908): Terminated: ok {rc=0} 21:04:10.027002 bus /gobi_0: Setting Powered False 21:04:11.126263 bus /gobi_0: Setting Powered False 21:04:12.242612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 21:04:13.387207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.398981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:13.465240 tst iperf3.py: using LAC 23712 21:04:13.587811 tst iperf3.py: using RAC 252 21:04:13.706497 tst iperf3.py: using CellId 23712 21:04:13.826115 tst iperf3.py: using BVCI 23713 21:04:13.937986 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.948925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.959768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.971109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.982298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:13.993360 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:14.004741 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:14.015804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:14.027206 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:14.142469 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:04:14.345152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:14.647769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14910): Launched 21:04:14.910698 run iperf3-srv_10.42.42.10(pid=14911): Launched 21:04:15.025307 tst iperf3.py:8: start network... 21:04:15.228333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:15.697290 run create_hlr_db(pid=14912): Launched 21:04:15.811911 bus /gobi_6: Setting Powered False 21:04:16.871397 run create_hlr_db(pid=14912): Terminated: ok {rc=0} 21:04:17.348391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Launched 21:04:17.671463 run osmo-hlr_10.42.42.2(pid=14915): Launched 21:04:17.794455 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:18.354280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Launched 21:04:18.677785 run osmo-stp_10.42.42.5(pid=14918): Launched 21:04:18.799846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:19.358916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Launched 21:04:19.482289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:19.755659 run patchelf(pid=14921): Launched 21:04:19.935350 run osmo-stp_10.42.42.5(pid=14918): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] 21:04:20.072419 run osmo-stp_10.42.42.5(pid=14918): stdout: | (launched: 2022-12-09_21:04:18.618515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:20.210561 run osmo-stp_10.42.42.5(pid=14918): stderr: | 20221209210418814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210418814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210418814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210418815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210418815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210418815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210418815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:20.348702 run osmo-stp_10.42.42.5(pid=14918): stdout: | (launched: 2022-12-09_21:04:18.618515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:20.481233 run osmo-stp_10.42.42.5(pid=14918): stderr: | 20221209210418814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210418814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210418814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210418815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210418815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210418815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210418815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:20.637993 run patchelf(pid=14921): Terminating (SIGINT) 21:04:20.818316 run patchelf(pid=14921): Terminated: ok {rc=0} 21:04:20.948575 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14918): Process ended prematurely: osmo-stp_10.42.42.5(pid=14918) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 21:04:20.958838 tst iperf3.py:8: Test FAILED (7.6 sec) 21:04:20.987324 run osmo-hlr_10.42.42.2(pid=14915): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14915)] 21:04:21.037827 run osmo-hlr_10.42.42.2(pid=14915): stdout: | (launched: 2022-12-09_21:04:17.612294) 21:04:21.089463 run osmo-hlr_10.42.42.2(pid=14915): stderr: | 20221209210417811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210417811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210417811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210417811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210417811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210417811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210417824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210417832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210417832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210417832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:21.141588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14910): Terminating (SIGTERM) 21:04:21.183382 run iperf3-srv_10.42.42.10(pid=14911): Terminating (SIGTERM) 21:04:21.224844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Terminating (SIGTERM) 21:04:21.266540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Terminating (SIGTERM) 21:04:21.308030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Terminating (SIGTERM) 21:04:21.350051 --- ParallelTerminationStrategy: PID 14910 died... 21:04:21.369754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14910): Terminated: ok {rc=0} 21:04:21.415731 --- ParallelTerminationStrategy: PID 14911 died... 21:04:21.435184 run iperf3-srv_10.42.42.10(pid=14911): Terminated {rc=256} 21:04:21.480620 --- ParallelTerminationStrategy: PID 14914 died... 21:04:21.500086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14914): Terminated: ok {rc=0} 21:04:21.545616 --- ParallelTerminationStrategy: PID 14917 died... 21:04:21.565091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14917): Terminated: ok {rc=0} 21:04:21.610559 --- ParallelTerminationStrategy: PID 14920 died... 21:04:21.630121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14920): Terminated: ok {rc=0} 21:04:21.717458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 21:04:22.866585 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:22.878951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:22.946870 tst iperf3m4.py: using LAC 23713 21:04:23.073676 tst iperf3m4.py: using RAC 253 21:04:23.202061 tst iperf3m4.py: using CellId 23713 21:04:23.322715 tst iperf3m4.py: using BVCI 23714 21:04:23.434189 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.445209 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.456086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.467123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.478261 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.489260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.500292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.511289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:23.522814 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:23.639402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:23.761966 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:23.879929 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:23.995705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:04:24.199277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:24.502738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14922): Launched 21:04:24.765314 run iperf3-srv_10.42.42.10(pid=14923): Launched 21:04:24.878866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:04:25.081593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:25.385994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14924): Launched 21:04:25.648492 run iperf3-srv_10.42.42.10(pid=14925): Launched 21:04:25.761430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:04:25.963488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:26.267247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14926): Launched 21:04:26.530685 run iperf3-srv_10.42.42.10(pid=14927): Launched 21:04:26.643662 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:04:26.845853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:04:27.149727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14928): Launched 21:04:27.412772 run iperf3-srv_10.42.42.10(pid=14929): Launched 21:04:27.525580 tst iperf3m4.py:8: start network... 21:04:27.727373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:28.195894 run create_hlr_db(pid=14930): Launched 21:04:28.312095 bus /gobi_6: Setting Powered False 21:04:29.371951 run create_hlr_db(pid=14930): Terminated: ok {rc=0} 21:04:29.793733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14932): Launched 21:04:30.097242 run osmo-hlr_10.42.42.2(pid=14933): Launched 21:04:30.212411 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:30.750552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14935): Launched 21:04:31.068112 run osmo-stp_10.42.42.5(pid=14936): Launched 21:04:31.182329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:31.849670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14938): Launched 21:04:31.979228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:32.246460 run patchelf(pid=14939): Launched 21:04:32.426592 run osmo-stp_10.42.42.5(pid=14936): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14936)] 21:04:32.554698 run osmo-stp_10.42.42.5(pid=14936): stdout: | (launched: 2022-12-09_21:04:31.008548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:32.684237 run osmo-stp_10.42.42.5(pid=14936): stderr: | 20221209210431383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210431383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210431383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210431383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210431384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210431384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210431384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:32.814011 run osmo-stp_10.42.42.5(pid=14936): stdout: | (launched: 2022-12-09_21:04:31.008548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:32.938147 run osmo-stp_10.42.42.5(pid=14936): stderr: | 20221209210431383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210431383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210431383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210431383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210431384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210431384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210431384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:33.085084 run patchelf(pid=14939): Terminating (SIGINT) 21:04:33.254884 run patchelf(pid=14939): Terminated: ok {rc=0} 21:04:33.377217 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14936): Process ended prematurely: osmo-stp_10.42.42.5(pid=14936) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14936)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 21:04:33.387010 tst iperf3m4.py:8: Test FAILED (10.6 sec) 21:04:33.415132 run osmo-hlr_10.42.42.2(pid=14933): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14933)] 21:04:33.462824 run osmo-hlr_10.42.42.2(pid=14933): stdout: | (launched: 2022-12-09_21:04:30.041188) 21:04:33.512227 run osmo-hlr_10.42.42.2(pid=14933): stderr: | 20221209210430213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210430213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210430213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210430213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210430213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210430213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210430227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210430235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210430235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210430235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:33.562139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14922): Terminating (SIGTERM) 21:04:33.601933 run iperf3-srv_10.42.42.10(pid=14923): Terminating (SIGTERM) 21:04:33.641554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14924): Terminating (SIGTERM) 21:04:33.681198 run iperf3-srv_10.42.42.10(pid=14925): Terminating (SIGTERM) 21:04:33.721156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14926): Terminating (SIGTERM) 21:04:33.761014 run iperf3-srv_10.42.42.10(pid=14927): Terminating (SIGTERM) 21:04:33.800500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14928): Terminating (SIGTERM) 21:04:33.840215 run iperf3-srv_10.42.42.10(pid=14929): Terminating (SIGTERM) 21:04:33.879753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14932): Terminating (SIGTERM) 21:04:33.919428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14935): Terminating (SIGTERM) 21:04:33.958949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14938): Terminating (SIGTERM) 21:04:33.998879 --- ParallelTerminationStrategy: PID 14922 died... 21:04:34.017917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14922): Terminated: ok {rc=0} 21:04:34.062123 --- ParallelTerminationStrategy: PID 14923 died... 21:04:34.080397 run iperf3-srv_10.42.42.10(pid=14923): Terminated {rc=256} 21:04:34.124484 --- ParallelTerminationStrategy: PID 14924 died... 21:04:34.143041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14924): Terminated: ok {rc=0} 21:04:34.186803 --- ParallelTerminationStrategy: PID 14925 died... 21:04:34.205198 run iperf3-srv_10.42.42.10(pid=14925): Terminated {rc=256} 21:04:34.249045 --- ParallelTerminationStrategy: PID 14926 died... 21:04:34.267567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14926): Terminated: ok {rc=0} 21:04:34.312148 --- ParallelTerminationStrategy: PID 14927 died... 21:04:34.330750 run iperf3-srv_10.42.42.10(pid=14927): Terminated {rc=256} 21:04:34.374707 --- ParallelTerminationStrategy: PID 14928 died... 21:04:34.393292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14928): Terminated: ok {rc=0} 21:04:34.437255 --- ParallelTerminationStrategy: PID 14929 died... 21:04:34.455528 run iperf3-srv_10.42.42.10(pid=14929): Terminated {rc=256} 21:04:34.500187 --- ParallelTerminationStrategy: PID 14932 died... 21:04:34.518722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14932): Terminated: ok {rc=0} 21:04:34.562683 --- ParallelTerminationStrategy: PID 14935 died... 21:04:34.581223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14935): Terminated: ok {rc=0} 21:04:34.625290 --- ParallelTerminationStrategy: PID 14938 died... 21:04:34.643691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14938): Terminated: ok {rc=0} 21:04:34.728878 bus /gobi_4: Setting Powered False 21:04:35.828235 bus /gobi_4: Setting Powered False 21:04:36.940288 bus /gobi_1: Setting Powered False 21:04:38.037244 bus /gobi_1: Setting Powered False 21:04:39.150921 bus /gobi_0: Setting Powered False 21:04:40.245009 bus /gobi_0: Setting Powered False 21:04:41.356362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 21:04:42.455517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:42.467243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:42.534258 tst ping.py: using LAC 23714 21:04:42.660310 tst ping.py: using RAC 254 21:04:42.787149 tst ping.py: using CellId 23714 21:04:42.910929 tst ping.py: using BVCI 23715 21:04:43.028234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.039950 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.051292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.062703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.074181 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.085559 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.097005 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:43.108286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:43.223203 tst ping.py:19: start network... 21:04:43.421139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:43.878966 run create_hlr_db(pid=14940): Launched 21:04:43.991677 bus /gobi_6: Setting Powered False 21:04:45.050440 run create_hlr_db(pid=14940): Terminated: ok {rc=0} 21:04:45.486196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14942): Launched 21:04:45.803506 run osmo-hlr_10.42.42.2(pid=14943): Launched 21:04:46.040798 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:46.621467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14945): Launched 21:04:46.945826 run osmo-stp_10.42.42.5(pid=14946): Launched 21:04:47.182322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:47.809016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14948): Launched 21:04:47.922890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:48.173473 run patchelf(pid=14949): Launched 21:04:48.338883 run osmo-stp_10.42.42.5(pid=14946): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] 21:04:48.464524 run osmo-stp_10.42.42.5(pid=14946): stdout: | (launched: 2022-12-09_21:04:46.879690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:48.592145 run osmo-stp_10.42.42.5(pid=14946): stderr: | 20221209210447214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210447214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210447214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210447215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210447215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210447215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210447215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:48.720076 run osmo-stp_10.42.42.5(pid=14946): stdout: | (launched: 2022-12-09_21:04:46.879690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:48.842279 run osmo-stp_10.42.42.5(pid=14946): stderr: | 20221209210447214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210447214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210447214 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210447215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210447215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210447215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210447215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:48.987163 run patchelf(pid=14949): Terminating (SIGINT) 21:04:49.153651 run patchelf(pid=14949): Terminated: ok {rc=0} 21:04:49.274014 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14946): Process ended prematurely: osmo-stp_10.42.42.5(pid=14946) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 21:04:49.282999 tst ping.py:22: Test FAILED (6.8 sec) 21:04:49.310139 run osmo-hlr_10.42.42.2(pid=14943): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14943)] 21:04:49.357746 run osmo-hlr_10.42.42.2(pid=14943): stdout: | (launched: 2022-12-09_21:04:45.745549) 21:04:49.407073 run osmo-hlr_10.42.42.2(pid=14943): stderr: | 20221209210445952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210445952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210445953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210445953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210445953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210445953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210445967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210445985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210445986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210445986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:49.456613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14942): Terminating (SIGTERM) 21:04:49.495680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14945): Terminating (SIGTERM) 21:04:49.535303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14948): Terminating (SIGTERM) 21:04:49.574728 --- ParallelTerminationStrategy: PID 14942 died... 21:04:49.593697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14942): Terminated: ok {rc=0} 21:04:49.637073 --- ParallelTerminationStrategy: PID 14945 died... 21:04:49.655721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14945): Terminated: ok {rc=0} 21:04:49.699085 --- ParallelTerminationStrategy: PID 14948 died... 21:04:49.717453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14948): Terminated: ok {rc=0} 21:04:49.800134 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 21:04:50.886394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:50.899112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 21:04:50.970004 tst ping_idle_ping.py: using LAC 23715 21:04:51.100318 tst ping_idle_ping.py: using RAC 255 21:04:51.225086 tst ping_idle_ping.py: using CellId 23715 21:04:51.348513 tst ping_idle_ping.py: using BVCI 23716 21:04:51.465076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.476703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.488109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.499947 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.511691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.523636 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.535593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 21:04:51.547351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 21:04:51.667237 tst ping_idle_ping.py:24: start network... 21:04:51.882963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:04:52.379606 run create_hlr_db(pid=14950): Launched 21:04:52.509134 bus /gobi_6: Setting Powered False 21:04:53.572705 run create_hlr_db(pid=14950): Terminated: ok {rc=0} 21:04:54.016415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Launched 21:04:54.334999 run osmo-hlr_10.42.42.2(pid=14953): Launched 21:04:54.458322 run osmo-stp_10.42.42.5: Starting osmo-stp 21:04:55.005612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14955): Launched 21:04:55.322219 run osmo-stp_10.42.42.5(pid=14956): Launched 21:04:55.443404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:04:55.991099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14958): Launched 21:04:56.112377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:04:56.381199 run patchelf(pid=14959): Launched 21:04:56.558955 run osmo-stp_10.42.42.5(pid=14956): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14956)] 21:04:56.693465 run osmo-stp_10.42.42.5(pid=14956): stdout: | (launched: 2022-12-09_21:04:55.264049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:56.830025 run osmo-stp_10.42.42.5(pid=14956): stderr: | 20221209210455456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210455457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210455457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210455457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210455458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210455458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210455458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:56.966467 run osmo-stp_10.42.42.5(pid=14956): stdout: | (launched: 2022-12-09_21:04:55.264049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:04:57.097542 run osmo-stp_10.42.42.5(pid=14956): stderr: | 20221209210455456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210455457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210455457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210455457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210455458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210455458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210455458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:04:57.251656 run patchelf(pid=14959): Terminating (SIGINT) 21:04:57.429886 run patchelf(pid=14959): Terminated: ok {rc=0} 21:04:57.557929 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14956): Process ended prematurely: osmo-stp_10.42.42.5(pid=14956) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14956)] [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 21:04:57.567630 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:04:57.595788 run osmo-hlr_10.42.42.2(pid=14953): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14953)] 21:04:57.645706 run osmo-hlr_10.42.42.2(pid=14953): stdout: | (launched: 2022-12-09_21:04:54.276799) 21:04:57.697273 run osmo-hlr_10.42.42.2(pid=14953): stderr: | 20221209210454475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210454475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210454475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210454475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210454475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210454475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210454488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210454496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210454496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210454496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:04:57.749539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Terminating (SIGTERM) 21:04:57.790963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14955): Terminating (SIGTERM) 21:04:57.832378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14958): Terminating (SIGTERM) 21:04:57.874264 --- ParallelTerminationStrategy: PID 14952 died... 21:04:57.894226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14952): Terminated: ok {rc=0} 21:04:57.940078 --- ParallelTerminationStrategy: PID 14955 died... 21:04:57.959487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14955): Terminated: ok {rc=0} 21:04:58.005104 --- ParallelTerminationStrategy: PID 14958 died... 21:04:58.024921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14958): Terminated: ok {rc=0} 21:04:58.111354 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:04:59.417840 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:04:59.424790 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:04:59.454765 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:04:59.489802 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:04:59.543261 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:04:59.572809 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:04:59.607976 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:05:00.169819 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:05:00.175083 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.186965 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:05:00.256247 tst switch_tch_pdch.py: using LAC 23716 21:05:00.380140 tst switch_tch_pdch.py: using RAC 1 21:05:00.502494 tst switch_tch_pdch.py: using CellId 23716 21:05:00.625181 tst switch_tch_pdch.py: using BVCI 23717 21:05:00.740080 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.751876 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.763469 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.775078 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.786755 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.798466 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.810228 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:05:00.821797 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:05:00.977496 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:05:01.123389 tst switch_tch_pdch.py:51: start network... 21:05:01.374676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:01.895064 run create_hlr_db(pid=14966): Launched 21:05:02.049141 bus /gobi_6: Setting Powered False 21:05:03.108943 run create_hlr_db(pid=14966): Terminated: ok {rc=0} 21:05:03.553824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14968): Launched 21:05:03.851337 run osmo-hlr_10.42.42.2(pid=14969): Launched 21:05:03.964332 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:04.477698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14971): Launched 21:05:04.776221 run osmo-stp_10.42.42.5(pid=14972): Launched 21:05:04.889841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:05:05.403722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14974): Launched 21:05:05.516902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:05:05.767998 run patchelf(pid=14975): Launched 21:05:05.932381 run osmo-stp_10.42.42.5(pid=14972): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14972)] 21:05:06.058122 run osmo-stp_10.42.42.5(pid=14972): stdout: | (launched: 2022-12-09_21:05:04.721389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:06.185270 run osmo-stp_10.42.42.5(pid=14972): stderr: | 20221209210504892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210504892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210504892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210504892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210504893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210504893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210504893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:06.312580 run osmo-stp_10.42.42.5(pid=14972): stdout: | (launched: 2022-12-09_21:05:04.721389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:06.434102 run osmo-stp_10.42.42.5(pid=14972): stderr: | 20221209210504892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210504892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210504892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210504892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210504893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210504893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210504893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:06.578020 run patchelf(pid=14975): Terminating (SIGINT) 21:05:06.744195 run patchelf(pid=14975): Terminated: ok {rc=0} 21:05:06.864234 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14972): Process ended prematurely: osmo-stp_10.42.42.5(pid=14972) [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14972)] [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:05:06.873445 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 21:05:06.900495 run osmo-hlr_10.42.42.2(pid=14969): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14969)] 21:05:06.947694 run osmo-hlr_10.42.42.2(pid=14969): stdout: | (launched: 2022-12-09_21:05:03.796202) 21:05:06.996738 run osmo-hlr_10.42.42.2(pid=14969): stderr: | 20221209210503969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210503969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210503969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210503969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210503969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210503969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210503982 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210503990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210503990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210503990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:07.046348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14968): Terminating (SIGTERM) 21:05:07.086168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14971): Terminating (SIGTERM) 21:05:07.125846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14974): Terminating (SIGTERM) 21:05:07.165847 --- ParallelTerminationStrategy: PID 14968 died... 21:05:07.184480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14968): Terminated: ok {rc=0} 21:05:07.227912 --- ParallelTerminationStrategy: PID 14971 died... 21:05:07.246981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14971): Terminated: ok {rc=0} 21:05:07.291197 --- ParallelTerminationStrategy: PID 14974 died... 21:05:07.309670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14974): Terminated: ok {rc=0} 21:05:07.392635 bus /gobi_0: Setting Powered False 21:05:08.486230 bus /gobi_0: Setting Powered False 21:05:09.600041 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 21:05:10.854945 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:10.860623 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 21:05:10.890140 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 21:05:10.924110 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 21:05:10.977643 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 21:05:11.007065 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 21:05:11.040923 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 21:05:11.596726 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 21:05:11.601848 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:11.612889 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 21:05:11.677599 tst switch_tch_pdch.py: using LAC 23717 21:05:11.802721 tst switch_tch_pdch.py: using RAC 2 21:05:11.930651 tst switch_tch_pdch.py: using CellId 23717 21:05:12.055542 tst switch_tch_pdch.py: using BVCI 23718 21:05:12.170920 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.182600 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.194029 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.205474 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.216755 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.228225 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.239951 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 21:05:12.251283 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:05:12.372249 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 21:05:12.491829 tst switch_tch_pdch.py:51: start network... 21:05:12.706139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:13.172032 run create_hlr_db(pid=14981): Launched 21:05:13.301522 bus /gobi_6: Setting Powered False 21:05:14.364723 run create_hlr_db(pid=14981): Terminated: ok {rc=0} 21:05:14.765629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14983): Launched 21:05:15.062905 run osmo-hlr_10.42.42.2(pid=14984): Launched 21:05:15.176743 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:15.664566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14986): Launched 21:05:15.981705 run osmo-stp_10.42.42.5(pid=14987): Launched 21:05:16.134872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:05:16.725097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14989): Launched 21:05:16.852150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:05:17.113779 run patchelf(pid=14990): Launched 21:05:17.297384 run osmo-stp_10.42.42.5(pid=14987): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14987)] 21:05:17.428819 run osmo-stp_10.42.42.5(pid=14987): stdout: | (launched: 2022-12-09_21:05:15.915855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:17.556763 run osmo-stp_10.42.42.5(pid=14987): stderr: | 20221209210516264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210516264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210516264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210516264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210516269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210516269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210516269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:17.685370 run osmo-stp_10.42.42.5(pid=14987): stdout: | (launched: 2022-12-09_21:05:15.915855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:17.807507 run osmo-stp_10.42.42.5(pid=14987): stderr: | 20221209210516264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210516264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210516264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210516264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210516269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210516269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210516269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:17.952252 run patchelf(pid=14990): Terminating (SIGINT) 21:05:18.119295 run patchelf(pid=14990): Terminated: ok {rc=0} 21:05:18.239911 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14987): Process ended prematurely: osmo-stp_10.42.42.5(pid=14987) [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14987)] [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 21:05:18.249104 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 21:05:18.276110 run osmo-hlr_10.42.42.2(pid=14984): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14984)] 21:05:18.324121 run osmo-hlr_10.42.42.2(pid=14984): stdout: | (launched: 2022-12-09_21:05:15.008269) 21:05:18.373350 run osmo-hlr_10.42.42.2(pid=14984): stderr: | 20221209210515183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210515183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210515183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210515184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210515184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210515184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210515197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210515207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210515207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210515207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:18.423041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14983): Terminating (SIGTERM) 21:05:18.462603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14986): Terminating (SIGTERM) 21:05:18.502127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14989): Terminating (SIGTERM) 21:05:18.542005 --- ParallelTerminationStrategy: PID 14983 died... 21:05:18.560877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14983): Terminated: ok {rc=0} 21:05:18.604754 --- ParallelTerminationStrategy: PID 14986 died... 21:05:18.623486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14986): Terminated: ok {rc=0} 21:05:18.667366 --- ParallelTerminationStrategy: PID 14989 died... 21:05:18.685788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14989): Terminated: ok {rc=0} 21:05:18.769137 bus /gobi_0: Setting Powered False 21:05:19.863540 bus /gobi_0: Setting Powered False 21:05:20.974339 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_sms:nanobts --------------------------------------------------------------------- 21:05:22.224872 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:22.229369 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 21:05:22.253753 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 21:05:22.261385 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 21:05:22.313209 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 21:05:22.337311 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 21:05:22.344582 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 21:05:22.883877 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 21:05:22.888728 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 21:05:22.901790 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 21:05:22.939629 tst mo_mt_sms.py: using LAC 23718 21:05:23.055235 tst mo_mt_sms.py: using RAC 3 21:05:23.170309 tst mo_mt_sms.py: using CellId 23718 21:05:23.287513 tst mo_mt_sms.py: using BVCI 23719 21:05:23.395112 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:05:23.507800 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 21:05:23.622296 tst mo_mt_sms.py:9: start nitb and bts... 21:05:23.836581 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:05:24.483244 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14994): Launched 21:05:24.800095 run osmo-nitb_10.42.42.2(pid=14995): Launched 21:05:24.975214 run osmo-nitb_10.42.42.2(pid=14995): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14995)] 21:05:25.117331 run osmo-nitb_10.42.42.2(pid=14995): stdout: | (launched: 2022-12-09_21:05:24.741922) 21:05:25.260545 run osmo-nitb_10.42.42.2(pid=14995): stderr: | (launched: 2022-12-09_21:05:24.789107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:25.403937 run osmo-nitb_10.42.42.2(pid=14995): stdout: | (launched: 2022-12-09_21:05:24.741922) 21:05:25.541632 run osmo-nitb_10.42.42.2(pid=14995): stderr: | (launched: 2022-12-09_21:05:24.789107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14995) [trial-2364↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14995)] 21:05:25.919819 tst osmo-nitb_10.42.42.2(pid=14995): stdout: | (launched: 2022-12-09_21:05:24.741922) 21:05:26.048492 tst osmo-nitb_10.42.42.2(pid=14995): stderr: | (launched: 2022-12-09_21:05:24.789107) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:26.200344 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14995) [trial-2364↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14995)] [trial-2364↪nitb_sms:nanobts↪mo_mt_sms.py:11] 21:05:26.209559 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 21:05:26.216574 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14994): Terminating (SIGTERM) 21:05:26.428135 --- ParallelTerminationStrategy: PID 14994 died... 21:05:26.449470 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14994): Terminated: ok {rc=0} 21:05:26.536776 bus /sierra_3: Setting Powered False 21:05:27.634185 bus /sierra_3: Setting Powered False 21:05:28.750654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:nanobts+band-1900 --------------------------------------------------------------------- 21:05:29.932323 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:29.937328 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:29.961356 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:05:29.988068 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 21:05:30.039472 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:30.063074 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:05:30.089562 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 21:05:30.636289 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 21:05:30.641301 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:30.651964 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:30.689338 tst mo_mt_sms.py: using LAC 23719 21:05:30.806292 tst mo_mt_sms.py: using RAC 4 21:05:30.932843 tst mo_mt_sms.py: using CellId 23719 21:05:31.050751 tst mo_mt_sms.py: using BVCI 23720 21:05:31.160061 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:31.171634 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:31.183203 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:31.195937 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:31.207369 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:31.219199 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:05:31.358177 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 21:05:31.506614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:32.046269 run create_hlr_db(pid=14999): Launched 21:05:32.216399 bus /sierra_2: Setting Powered False 21:05:33.279933 run create_hlr_db(pid=14999): Terminated: ok {rc=0} 21:05:33.726361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Launched 21:05:34.024003 run osmo-hlr_10.42.42.2(pid=15002): Launched 21:05:34.136371 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:34.645537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Launched 21:05:34.964391 run osmo-stp_10.42.42.5(pid=15005): Launched 21:05:35.084913 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:35.658449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15007): Launched 21:05:35.975786 run osmo-msc_10.42.42.6(pid=15008): Launched 21:05:36.152529 run osmo-stp_10.42.42.5(pid=15005): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] 21:05:36.285709 run osmo-stp_10.42.42.5(pid=15005): stdout: | (launched: 2022-12-09_21:05:34.905856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:36.419604 run osmo-stp_10.42.42.5(pid=15005): stderr: | 20221209210535097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210535097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210535097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210535098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210535098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210535098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210535098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:36.553154 run osmo-stp_10.42.42.5(pid=15005): stdout: | (launched: 2022-12-09_21:05:34.905856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:36.679688 run osmo-stp_10.42.42.5(pid=15005): stderr: | 20221209210535097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210535097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210535097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210535098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210535098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210535098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210535098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:36.831000 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15005): Process ended prematurely: osmo-stp_10.42.42.5(pid=15005) [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 21:05:36.840125 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 21:05:36.867342 run osmo-hlr_10.42.42.2(pid=15002): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15002)] 21:05:36.917181 run osmo-hlr_10.42.42.2(pid=15002): stdout: | (launched: 2022-12-09_21:05:33.968594) 21:05:36.968300 run osmo-hlr_10.42.42.2(pid=15002): stderr: | 20221209210534143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210534143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210534143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210534143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210534143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210534143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210534156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210534166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210534167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210534167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:37.039859 run osmo-msc_10.42.42.6(pid=15008): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15008)] 21:05:37.089695 run osmo-msc_10.42.42.6(pid=15008): stdout: | (launched: 2022-12-09_21:05:35.917234) 21:05:37.140644 run osmo-msc_10.42.42.6(pid=15008): stderr: | 20221209210536240 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210536240 DLGLOBAL DEBUG validating counter group 0x7faf37c70c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210536240 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210536240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210536240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210536241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210536242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210536243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210536243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210536243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:37.192149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Terminating (SIGTERM) 21:05:37.233649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Terminating (SIGTERM) 21:05:37.275199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15007): Terminating (SIGTERM) 21:05:37.316741 --- ParallelTerminationStrategy: PID 15001 died... 21:05:37.336432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15001): Terminated: ok {rc=0} 21:05:37.382393 --- ParallelTerminationStrategy: PID 15004 died... 21:05:37.401647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15004): Terminated: ok {rc=0} 21:05:37.447634 --- ParallelTerminationStrategy: PID 15007 died... 21:05:37.467169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15007): Terminated: ok {rc=0} 21:05:37.554130 bus /sierra_3: Setting Powered False 21:05:38.652069 bus /sierra_3: Setting Powered False 21:05:39.768497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:05:40.991368 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:40.996719 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:41.021419 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 21:05:41.028339 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:05:41.064129 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:41.088569 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 21:05:41.097768 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:05:41.614399 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:05:41.619551 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 21:05:41.630490 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:41.669434 tst assert_extension.py: using LAC 23720 21:05:41.794654 tst assert_extension.py: using RAC 5 21:05:41.919105 tst assert_extension.py: using CellId 23720 21:05:42.045471 tst assert_extension.py: using BVCI 23721 21:05:42.162882 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:05:42.277442 tst assert_extension.py:10: start nitb and bts... 21:05:42.476153 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:05:43.083250 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15013): Launched 21:05:43.380223 run osmo-nitb_10.42.42.2(pid=15014): Launched 21:05:43.544567 run osmo-nitb_10.42.42.2(pid=15014): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15014)] 21:05:43.677413 run osmo-nitb_10.42.42.2(pid=15014): stdout: | (launched: 2022-12-09_21:05:43.325276) 21:05:43.811582 run osmo-nitb_10.42.42.2(pid=15014): stderr: | (launched: 2022-12-09_21:05:43.369394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:43.946640 run osmo-nitb_10.42.42.2(pid=15014): stdout: | (launched: 2022-12-09_21:05:43.325276) 21:05:44.075825 run osmo-nitb_10.42.42.2(pid=15014): stderr: | (launched: 2022-12-09_21:05:43.369394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15014) [trial-2364↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15014)] 21:05:44.491955 tst osmo-nitb_10.42.42.2(pid=15014): stdout: | (launched: 2022-12-09_21:05:43.325276) 21:05:44.611506 tst osmo-nitb_10.42.42.2(pid=15014): stderr: | (launched: 2022-12-09_21:05:43.369394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:05:44.752820 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15014) [trial-2364↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15014)] [trial-2364↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 21:05:44.761415 tst assert_extension.py:12: Test FAILED (3.1 sec) 21:05:44.767981 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15013): Terminating (SIGTERM) 21:05:44.977466 --- ParallelTerminationStrategy: PID 15013 died... 21:05:44.997844 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15013): Terminated: ok {rc=0} 21:05:45.084030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:nanobts+band-1900 --------------------------------------------------------------------- 21:05:46.276448 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:46.283706 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:05:46.314544 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:05:46.350150 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 21:05:46.393933 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:05:46.430120 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:05:46.465407 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 21:05:46.987072 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 21:05:46.994550 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.009496 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:05:47.059795 tst assert_extension.py: using LAC 23721 21:05:47.191148 tst assert_extension.py: using RAC 6 21:05:47.320660 tst assert_extension.py: using CellId 23721 21:05:47.447944 tst assert_extension.py: using BVCI 23722 21:05:47.558719 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.569643 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.580491 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.592126 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.603660 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:05:47.615165 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 21:05:47.734420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:48.230557 run create_hlr_db(pid=15019): Launched 21:05:48.359995 bus /sierra_2: Setting Powered False 21:05:49.424209 run create_hlr_db(pid=15019): Terminated: ok {rc=0} 21:05:49.867765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Launched 21:05:50.185578 run osmo-hlr_10.42.42.2(pid=15022): Launched 21:05:50.308237 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:50.857219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Launched 21:05:51.176231 run osmo-stp_10.42.42.5(pid=15025): Launched 21:05:51.297089 run osmo-msc_10.42.42.6: Starting osmo-msc 21:05:51.871815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Launched 21:05:52.191222 run osmo-msc_10.42.42.6(pid=15028): Launched 21:05:52.368521 run osmo-stp_10.42.42.5(pid=15025): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] 21:05:52.502903 run osmo-stp_10.42.42.5(pid=15025): stdout: | (launched: 2022-12-09_21:05:51.117537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:52.637821 run osmo-stp_10.42.42.5(pid=15025): stderr: | 20221209210551308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210551308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210551308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210551309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210551309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210551309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210551309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:52.771612 run osmo-stp_10.42.42.5(pid=15025): stdout: | (launched: 2022-12-09_21:05:51.117537) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:05:52.898839 run osmo-stp_10.42.42.5(pid=15025): stderr: | 20221209210551308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210551308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210551308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210551309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210551309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210551309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210551309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:05:53.050910 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15025): Process ended prematurely: osmo-stp_10.42.42.5(pid=15025) [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py:17] 21:05:53.059864 tst assert_extension.py:17: Test FAILED (6.1 sec) 21:05:53.087788 run osmo-hlr_10.42.42.2(pid=15022): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15022)] 21:05:53.138291 run osmo-hlr_10.42.42.2(pid=15022): stdout: | (launched: 2022-12-09_21:05:50.127578) 21:05:53.190705 run osmo-hlr_10.42.42.2(pid=15022): stderr: | 20221209210550324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210550324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210550324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210550324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210550324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210550324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210550336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210550344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210550345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210550345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:05:53.263165 run osmo-msc_10.42.42.6(pid=15028): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15028)] 21:05:53.313743 run osmo-msc_10.42.42.6(pid=15028): stdout: | (launched: 2022-12-09_21:05:52.132449) 21:05:53.365591 run osmo-msc_10.42.42.6(pid=15028): stderr: | 20221209210552454 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210552454 DLGLOBAL DEBUG validating counter group 0x7f85c7b9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210552454 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210552454 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210552455 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210552455 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210552456 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210552457 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210552457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210552457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:05:53.418046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Terminating (SIGTERM) 21:05:53.459565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Terminating (SIGTERM) 21:05:53.501257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Terminating (SIGTERM) 21:05:53.543255 --- ParallelTerminationStrategy: PID 15021 died... 21:05:53.562979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15021): Terminated: ok {rc=0} 21:05:53.609532 --- ParallelTerminationStrategy: PID 15024 died... 21:05:53.629359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15024): Terminated: ok {rc=0} 21:05:53.675427 --- ParallelTerminationStrategy: PID 15027 died... 21:05:53.694993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15027): Terminated: ok {rc=0} 21:05:53.782767 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:05:54.987657 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:05:54.996130 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:05:55.021196 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:05:55.051222 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:05:55.102975 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:05:55.126569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:05:55.154518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:05:55.705682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:05:55.760608 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:55.772288 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:05:55.832620 tst mo_mt_call.py: using LAC 23722 21:05:55.960917 tst mo_mt_call.py: using RAC 7 21:05:56.087624 tst mo_mt_call.py: using CellId 23722 21:05:56.214054 tst mo_mt_call.py: using BVCI 23723 21:05:56.331794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:56.343501 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:56.355323 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:56.366768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:56.378338 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:05:56.389866 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:56.506863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:05:56.622935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:05:57.092710 run create_hlr_db(pid=15033): Launched 21:05:57.207864 bus /sierra_2: Setting Powered False 21:05:58.267730 run create_hlr_db(pid=15033): Terminated: ok {rc=0} 21:05:58.709711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Launched 21:05:59.033394 run osmo-hlr_10.42.42.2(pid=15036): Launched 21:05:59.159444 run osmo-stp_10.42.42.5: Starting osmo-stp 21:05:59.715649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Launched 21:06:00.037845 run osmo-stp_10.42.42.5(pid=15039): Launched 21:06:00.160908 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:00.745382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15041): Launched 21:06:01.097978 run osmo-msc_10.42.42.6(pid=15042): Launched 21:06:01.462403 run osmo-stp_10.42.42.5(pid=15039): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] 21:06:01.645609 run osmo-stp_10.42.42.5(pid=15039): stdout: | (launched: 2022-12-09_21:05:59.978895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:01.784011 run osmo-stp_10.42.42.5(pid=15039): stderr: | 20221209210600170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210600170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210600170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210600171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210600171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210600171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210600171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:01.953166 run osmo-stp_10.42.42.5(pid=15039): stdout: | (launched: 2022-12-09_21:05:59.978895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:02.085429 run osmo-stp_10.42.42.5(pid=15039): stderr: | 20221209210600170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210600170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210600170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210600171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210600171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210600171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210600171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:02.242969 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15039): Process ended prematurely: osmo-stp_10.42.42.5(pid=15039) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:06:02.253350 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 21:06:02.282165 run osmo-hlr_10.42.42.2(pid=15036): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15036)] 21:06:02.332832 run osmo-hlr_10.42.42.2(pid=15036): stdout: | (launched: 2022-12-09_21:05:58.974420) 21:06:02.384683 run osmo-hlr_10.42.42.2(pid=15036): stderr: | 20221209210559170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210559170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210559170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210559171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210559171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210559171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210559183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210559192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210559192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210559192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:02.456817 run osmo-msc_10.42.42.6(pid=15042): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15042)] 21:06:02.506857 run osmo-msc_10.42.42.6(pid=15042): stdout: | (launched: 2022-12-09_21:06:01.033005) 21:06:02.558376 run osmo-msc_10.42.42.6(pid=15042): stderr: | 20221209210601477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210601478 DLGLOBAL DEBUG validating counter group 0x7fc364942c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210601478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210601481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210601481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210601482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210601483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210601484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210601484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210601484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:02.610121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Terminating (SIGTERM) 21:06:02.651813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Terminating (SIGTERM) 21:06:02.693412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15041): Terminating (SIGTERM) 21:06:02.735256 --- ParallelTerminationStrategy: PID 15035 died... 21:06:02.755360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15035): Terminated: ok {rc=0} 21:06:02.801576 --- ParallelTerminationStrategy: PID 15038 died... 21:06:02.821247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15038): Terminated: ok {rc=0} 21:06:02.867160 --- ParallelTerminationStrategy: PID 15041 died... 21:06:02.886846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15041): Terminated: ok {rc=0} 21:06:02.973957 bus /sierra_3: Setting Powered False 21:06:04.073233 bus /sierra_3: Setting Powered False 21:06:05.188427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:06:06.329602 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.341359 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:06:06.403178 tst mo_mt_call_osmux.py: using LAC 23723 21:06:06.519942 tst mo_mt_call_osmux.py: using RAC 8 21:06:06.636619 tst mo_mt_call_osmux.py: using CellId 23723 21:06:06.755729 tst mo_mt_call_osmux.py: using BVCI 23724 21:06:06.867048 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.878183 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.889063 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.900178 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.911426 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:06:06.922605 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:06:07.038111 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:06:07.157332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:07.627125 run create_hlr_db(pid=15044): Launched 21:06:07.743220 bus /sierra_2: Setting Powered False 21:06:08.803314 run create_hlr_db(pid=15044): Terminated: ok {rc=0} 21:06:09.246242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Launched 21:06:09.569026 run osmo-hlr_10.42.42.2(pid=15047): Launched 21:06:09.692668 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:10.253052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Launched 21:06:10.576350 run osmo-stp_10.42.42.5(pid=15050): Launched 21:06:10.700149 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:11.287586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Launched 21:06:11.610605 run osmo-msc_10.42.42.6(pid=15053): Launched 21:06:11.793807 run osmo-stp_10.42.42.5(pid=15050): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] 21:06:11.929368 run osmo-stp_10.42.42.5(pid=15050): stdout: | (launched: 2022-12-09_21:06:10.516904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:12.066152 run osmo-stp_10.42.42.5(pid=15050): stderr: | 20221209210610709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210610709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210610709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210610710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210610710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210610710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210610710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:12.201208 run osmo-stp_10.42.42.5(pid=15050): stdout: | (launched: 2022-12-09_21:06:10.516904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:12.329773 run osmo-stp_10.42.42.5(pid=15050): stderr: | 20221209210610709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210610709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210610709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210610710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210610710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210610710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210610710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:12.483523 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15050): Process ended prematurely: osmo-stp_10.42.42.5(pid=15050) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:06:12.493346 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:06:12.521161 run osmo-hlr_10.42.42.2(pid=15047): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15047)] 21:06:12.571039 run osmo-hlr_10.42.42.2(pid=15047): stdout: | (launched: 2022-12-09_21:06:09.509504) 21:06:12.622208 run osmo-hlr_10.42.42.2(pid=15047): stderr: | 20221209210609707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210609707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210609707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210609707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210609707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210609708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210609719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210609728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210609728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210609728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:12.694160 run osmo-msc_10.42.42.6(pid=15053): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15053)] 21:06:12.743715 run osmo-msc_10.42.42.6(pid=15053): stdout: | (launched: 2022-12-09_21:06:11.551720) 21:06:12.795120 run osmo-msc_10.42.42.6(pid=15053): stderr: | 20221209210611876 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210611876 DLGLOBAL DEBUG validating counter group 0x7fbd1d912c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210611877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210611877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210611877 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210611877 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210611879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210611879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210611879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210611879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:12.846642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Terminating (SIGTERM) 21:06:12.887630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Terminating (SIGTERM) 21:06:12.928397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Terminating (SIGTERM) 21:06:12.969568 --- ParallelTerminationStrategy: PID 15046 died... 21:06:12.989383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15046): Terminated: ok {rc=0} 21:06:13.034684 --- ParallelTerminationStrategy: PID 15049 died... 21:06:13.053957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15049): Terminated: ok {rc=0} 21:06:13.099343 --- ParallelTerminationStrategy: PID 15052 died... 21:06:13.118688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15052): Terminated: ok {rc=0} 21:06:13.204437 bus /sierra_3: Setting Powered False 21:06:14.302503 bus /sierra_3: Setting Powered False 21:06:15.416891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:06:16.671970 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:16.680042 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:06:16.705369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:06:16.733715 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:06:16.786009 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:06:16.810898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:06:16.840041 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:06:17.391912 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:06:17.443419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:17.455023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:06:17.516594 tst mo_mt_call.py: using LAC 23724 21:06:17.642679 tst mo_mt_call.py: using RAC 9 21:06:17.769534 tst mo_mt_call.py: using CellId 23724 21:06:17.894792 tst mo_mt_call.py: using BVCI 23725 21:06:18.011624 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:18.023249 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:18.034699 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:18.046240 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:18.057988 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:18.070031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:18.185946 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:18.301491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:18.771185 run create_hlr_db(pid=15058): Launched 21:06:18.887948 bus /sierra_2: Setting Powered False 21:06:19.947463 run create_hlr_db(pid=15058): Terminated: ok {rc=0} 21:06:20.389401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15060): Launched 21:06:20.712747 run osmo-hlr_10.42.42.2(pid=15061): Launched 21:06:20.836859 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:21.395856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15063): Launched 21:06:21.718253 run osmo-stp_10.42.42.5(pid=15064): Launched 21:06:21.841292 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:22.486570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15066): Launched 21:06:22.810185 run osmo-msc_10.42.42.6(pid=15067): Launched 21:06:22.989643 run osmo-stp_10.42.42.5(pid=15064): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] 21:06:23.126046 run osmo-stp_10.42.42.5(pid=15064): stdout: | (launched: 2022-12-09_21:06:21.659037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:23.262028 run osmo-stp_10.42.42.5(pid=15064): stderr: | 20221209210621852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210621852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210621852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210621853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210621853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210621853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210621853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:23.397111 run osmo-stp_10.42.42.5(pid=15064): stdout: | (launched: 2022-12-09_21:06:21.659037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:23.525814 run osmo-stp_10.42.42.5(pid=15064): stderr: | 20221209210621852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210621852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210621852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210621853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210621853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210621853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210621853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:23.679506 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15064): Process ended prematurely: osmo-stp_10.42.42.5(pid=15064) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:06:23.689146 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:06:23.716681 run osmo-hlr_10.42.42.2(pid=15061): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15061)] 21:06:23.766134 run osmo-hlr_10.42.42.2(pid=15061): stdout: | (launched: 2022-12-09_21:06:20.654101) 21:06:23.817158 run osmo-hlr_10.42.42.2(pid=15061): stderr: | 20221209210620854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210620854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210620854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210620854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210620854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210620854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210620869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210620879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210620879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210620879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:23.888497 run osmo-msc_10.42.42.6(pid=15067): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15067)] 21:06:23.938344 run osmo-msc_10.42.42.6(pid=15067): stdout: | (launched: 2022-12-09_21:06:22.750579) 21:06:23.989332 run osmo-msc_10.42.42.6(pid=15067): stderr: | 20221209210623072 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210623072 DLGLOBAL DEBUG validating counter group 0x7fce53286c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210623072 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210623072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210623072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210623073 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210623074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210623075 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210623075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210623075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:24.040712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15060): Terminating (SIGTERM) 21:06:24.082327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15063): Terminating (SIGTERM) 21:06:24.123860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15066): Terminating (SIGTERM) 21:06:24.165516 --- ParallelTerminationStrategy: PID 15060 died... 21:06:24.185061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15060): Terminated: ok {rc=0} 21:06:24.230411 --- ParallelTerminationStrategy: PID 15063 died... 21:06:24.249527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15063): Terminated: ok {rc=0} 21:06:24.294654 --- ParallelTerminationStrategy: PID 15066 died... 21:06:24.313886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15066): Terminated: ok {rc=0} 21:06:24.401301 bus /sierra_3: Setting Powered False 21:06:25.499439 bus /sierra_3: Setting Powered False 21:06:26.614006 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:06:27.761540 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:27.773742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:06:27.834837 tst mo_mt_call_osmux.py: using LAC 23725 21:06:27.955815 tst mo_mt_call_osmux.py: using RAC 10 21:06:28.075147 tst mo_mt_call_osmux.py: using CellId 23725 21:06:28.194427 tst mo_mt_call_osmux.py: using BVCI 23726 21:06:28.305834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:28.317116 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:28.328090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:28.339567 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:28.350999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:06:28.362338 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:28.481708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:06:28.602015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:29.104266 run create_hlr_db(pid=15069): Launched 21:06:29.235749 bus /sierra_2: Setting Powered False 21:06:30.299343 run create_hlr_db(pid=15069): Terminated: ok {rc=0} 21:06:30.748287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Launched 21:06:31.093776 run osmo-hlr_10.42.42.2(pid=15072): Launched 21:06:31.301463 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:31.920507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Launched 21:06:32.245712 run osmo-stp_10.42.42.5(pid=15075): Launched 21:06:32.388031 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:32.975141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Launched 21:06:33.300752 run osmo-msc_10.42.42.6(pid=15078): Launched 21:06:33.480140 run osmo-stp_10.42.42.5(pid=15075): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] 21:06:33.616683 run osmo-stp_10.42.42.5(pid=15075): stdout: | (launched: 2022-12-09_21:06:32.181557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:33.753231 run osmo-stp_10.42.42.5(pid=15075): stderr: | 20221209210632398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210632398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210632398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210632399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210632399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210632399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210632399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:33.888922 run osmo-stp_10.42.42.5(pid=15075): stdout: | (launched: 2022-12-09_21:06:32.181557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:34.018579 run osmo-stp_10.42.42.5(pid=15075): stderr: | 20221209210632398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210632398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210632398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210632399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210632399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210632399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210632399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:34.174325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15075): Process ended prematurely: osmo-stp_10.42.42.5(pid=15075) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:06:34.184176 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 21:06:34.212407 run osmo-hlr_10.42.42.2(pid=15072): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15072)] 21:06:34.262233 run osmo-hlr_10.42.42.2(pid=15072): stdout: | (launched: 2022-12-09_21:06:31.027181) 21:06:34.313721 run osmo-hlr_10.42.42.2(pid=15072): stderr: | 20221209210631396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210631396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210631396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210631396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210631396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210631396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210631411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210631429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210631429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210631429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:34.385628 run osmo-msc_10.42.42.6(pid=15078): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15078)] 21:06:34.435095 run osmo-msc_10.42.42.6(pid=15078): stdout: | (launched: 2022-12-09_21:06:33.241381) 21:06:34.486316 run osmo-msc_10.42.42.6(pid=15078): stderr: | 20221209210633563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210633563 DLGLOBAL DEBUG validating counter group 0x7f3f31f1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210633563 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210633563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210633563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210633564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210633565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210633566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210633566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210633566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:34.538055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Terminating (SIGTERM) 21:06:34.579734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Terminating (SIGTERM) 21:06:34.621428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Terminating (SIGTERM) 21:06:34.663376 --- ParallelTerminationStrategy: PID 15071 died... 21:06:34.683426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15071): Terminated: ok {rc=0} 21:06:34.729709 --- ParallelTerminationStrategy: PID 15074 died... 21:06:34.749277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15074): Terminated: ok {rc=0} 21:06:34.795667 --- ParallelTerminationStrategy: PID 15077 died... 21:06:34.815274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15077): Terminated: ok {rc=0} 21:06:34.901896 bus /sierra_3: Setting Powered False 21:06:36.001396 bus /sierra_3: Setting Powered False 21:06:37.117018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:06:38.358401 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:38.366499 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:06:38.391020 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:06:38.418545 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:06:38.471048 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:06:38.495657 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:06:38.522962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:06:39.078011 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:06:39.130318 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.142184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:39.203676 tst mo_mt_call.py: using LAC 23726 21:06:39.334018 tst mo_mt_call.py: using RAC 11 21:06:39.460453 tst mo_mt_call.py: using CellId 23726 21:06:39.585761 tst mo_mt_call.py: using BVCI 23727 21:06:39.703468 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.715162 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.726691 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.738331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.750152 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:39.761841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:39.878220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:39.996064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:40.465920 run create_hlr_db(pid=15083): Launched 21:06:40.581265 bus /sierra_2: Setting Powered False 21:06:41.641513 run create_hlr_db(pid=15083): Terminated: ok {rc=0} 21:06:42.082633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15085): Launched 21:06:42.406118 run osmo-hlr_10.42.42.2(pid=15086): Launched 21:06:42.530538 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:43.085375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15088): Launched 21:06:43.407882 run osmo-stp_10.42.42.5(pid=15089): Launched 21:06:43.530879 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:44.116492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15091): Launched 21:06:44.441040 run osmo-msc_10.42.42.6(pid=15092): Launched 21:06:44.621742 run osmo-stp_10.42.42.5(pid=15089): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15089)] 21:06:44.758332 run osmo-stp_10.42.42.5(pid=15089): stdout: | (launched: 2022-12-09_21:06:43.348523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:44.896178 run osmo-stp_10.42.42.5(pid=15089): stderr: | 20221209210643540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210643540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210643541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210643541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210643541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210643542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210643542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:45.031913 run osmo-stp_10.42.42.5(pid=15089): stdout: | (launched: 2022-12-09_21:06:43.348523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:45.161906 run osmo-stp_10.42.42.5(pid=15089): stderr: | 20221209210643540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210643540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210643541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210643541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210643541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210643542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210643542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:45.316207 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15089): Process ended prematurely: osmo-stp_10.42.42.5(pid=15089) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15089)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:06:45.326208 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:06:45.354309 run osmo-hlr_10.42.42.2(pid=15086): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15086)] 21:06:45.404173 run osmo-hlr_10.42.42.2(pid=15086): stdout: | (launched: 2022-12-09_21:06:42.347453) 21:06:45.455742 run osmo-hlr_10.42.42.2(pid=15086): stderr: | 20221209210642545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210642545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210642545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210642545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210642545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210642545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210642561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210642570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210642571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210642571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:45.527634 run osmo-msc_10.42.42.6(pid=15092): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15092)] 21:06:45.577270 run osmo-msc_10.42.42.6(pid=15092): stdout: | (launched: 2022-12-09_21:06:44.381455) 21:06:45.628382 run osmo-msc_10.42.42.6(pid=15092): stderr: | 20221209210644704 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210644704 DLGLOBAL DEBUG validating counter group 0x7f34f22a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210644704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210644704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210644704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210644705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210644706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210644707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210644707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210644707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:45.679971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15085): Terminating (SIGTERM) 21:06:45.721462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15088): Terminating (SIGTERM) 21:06:45.763037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15091): Terminating (SIGTERM) 21:06:45.804903 --- ParallelTerminationStrategy: PID 15085 died... 21:06:45.824830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15085): Terminated: ok {rc=0} 21:06:45.882021 --- ParallelTerminationStrategy: PID 15088 died... 21:06:45.903607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15088): Terminated: ok {rc=0} 21:06:45.968583 --- ParallelTerminationStrategy: PID 15091 died... 21:06:45.996912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15091): Terminated: ok {rc=0} 21:06:46.090327 bus /sierra_3: Setting Powered False 21:06:47.187455 bus /sierra_3: Setting Powered False 21:06:48.303865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:06:49.450038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:49.461879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:06:49.523291 tst mo_mt_call_osmux.py: using LAC 23727 21:06:49.641617 tst mo_mt_call_osmux.py: using RAC 12 21:06:49.760117 tst mo_mt_call_osmux.py: using CellId 23727 21:06:49.881582 tst mo_mt_call_osmux.py: using BVCI 23728 21:06:50.000321 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:50.012278 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:50.024057 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:50.036351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:50.048472 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:06:50.060663 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:50.180054 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:06:50.301130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:06:50.804440 run create_hlr_db(pid=15094): Launched 21:06:50.935475 bus /sierra_2: Setting Powered False 21:06:51.999123 run create_hlr_db(pid=15094): Terminated: ok {rc=0} 21:06:52.431896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Launched 21:06:52.733917 run osmo-hlr_10.42.42.2(pid=15097): Launched 21:06:52.848918 run osmo-stp_10.42.42.5: Starting osmo-stp 21:06:53.378497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Launched 21:06:53.680132 run osmo-stp_10.42.42.5(pid=15100): Launched 21:06:53.794581 run osmo-msc_10.42.42.6: Starting osmo-msc 21:06:54.346379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15102): Launched 21:06:54.651790 run osmo-msc_10.42.42.6(pid=15103): Launched 21:06:54.820679 run osmo-stp_10.42.42.5(pid=15100): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] 21:06:54.949095 run osmo-stp_10.42.42.5(pid=15100): stdout: | (launched: 2022-12-09_21:06:53.624262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:55.077688 run osmo-stp_10.42.42.5(pid=15100): stderr: | 20221209210653797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210653797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210653797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210653797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210653798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210653798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210653798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:55.204071 run osmo-stp_10.42.42.5(pid=15100): stdout: | (launched: 2022-12-09_21:06:53.624262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:06:55.324914 run osmo-stp_10.42.42.5(pid=15100): stderr: | 20221209210653797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210653797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210653797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210653797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210653798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210653798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210653798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:06:55.469736 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15100): Process ended prematurely: osmo-stp_10.42.42.5(pid=15100) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:06:55.479019 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:06:55.506083 run osmo-hlr_10.42.42.2(pid=15097): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15097)] 21:06:55.553546 run osmo-hlr_10.42.42.2(pid=15097): stdout: | (launched: 2022-12-09_21:06:52.678688) 21:06:55.602480 run osmo-hlr_10.42.42.2(pid=15097): stderr: | 20221209210652856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210652856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210652856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210652856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210652857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210652857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210652869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210652878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210652878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210652878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:06:55.670732 run osmo-msc_10.42.42.6(pid=15103): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15103)] 21:06:55.718206 run osmo-msc_10.42.42.6(pid=15103): stdout: | (launched: 2022-12-09_21:06:54.593986) 21:06:55.766962 run osmo-msc_10.42.42.6(pid=15103): stderr: | 20221209210654869 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210654869 DLGLOBAL DEBUG validating counter group 0x7fc2120dfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210654869 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210654869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210654869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210654870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210654872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210654872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210654872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210654873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:06:55.816345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Terminating (SIGTERM) 21:06:55.856117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Terminating (SIGTERM) 21:06:55.895745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15102): Terminating (SIGTERM) 21:06:55.935603 --- ParallelTerminationStrategy: PID 15096 died... 21:06:55.954682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15096): Terminated: ok {rc=0} 21:06:55.998908 --- ParallelTerminationStrategy: PID 15099 died... 21:06:56.017530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15099): Terminated: ok {rc=0} 21:06:56.061398 --- ParallelTerminationStrategy: PID 15102 died... 21:06:56.079887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15102): Terminated: ok {rc=0} 21:06:56.165202 bus /sierra_3: Setting Powered False 21:06:57.262769 bus /sierra_3: Setting Powered False 21:06:58.378321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:06:59.623109 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:06:59.631085 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:06:59.655526 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:06:59.682664 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:06:59.735947 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:06:59.759474 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:06:59.786566 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:07:00.340233 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:07:00.391914 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:00.403811 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:07:00.464921 tst mo_mt_call.py: using LAC 23728 21:07:00.593078 tst mo_mt_call.py: using RAC 13 21:07:00.720046 tst mo_mt_call.py: using CellId 23728 21:07:00.851012 tst mo_mt_call.py: using BVCI 23729 21:07:00.998052 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.010672 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.023106 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.035729 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.048404 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:01.060870 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:01.178143 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:01.328609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:01.839946 run create_hlr_db(pid=15108): Launched 21:07:02.005254 bus /sierra_2: Setting Powered False 21:07:03.069518 run create_hlr_db(pid=15108): Terminated: ok {rc=0} 21:07:03.519179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15110): Launched 21:07:03.841963 run osmo-hlr_10.42.42.2(pid=15111): Launched 21:07:03.965444 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:04.521877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15113): Launched 21:07:04.845129 run osmo-stp_10.42.42.5(pid=15114): Launched 21:07:04.968525 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:05.553339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15116): Launched 21:07:05.876495 run osmo-msc_10.42.42.6(pid=15117): Launched 21:07:06.056350 run osmo-stp_10.42.42.5(pid=15114): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15114)] 21:07:06.196810 run osmo-stp_10.42.42.5(pid=15114): stdout: | (launched: 2022-12-09_21:07:04.786048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:06.331839 run osmo-stp_10.42.42.5(pid=15114): stderr: | 20221209210704978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210704978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210704978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210704979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210704979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210704979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210704979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:06.466331 run osmo-stp_10.42.42.5(pid=15114): stdout: | (launched: 2022-12-09_21:07:04.786048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:06.594790 run osmo-stp_10.42.42.5(pid=15114): stderr: | 20221209210704978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210704978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210704978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210704979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210704979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210704979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210704979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:06.748283 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15114): Process ended prematurely: osmo-stp_10.42.42.5(pid=15114) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15114)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:07:06.757879 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:07:06.785296 run osmo-hlr_10.42.42.2(pid=15111): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15111)] 21:07:06.834620 run osmo-hlr_10.42.42.2(pid=15111): stdout: | (launched: 2022-12-09_21:07:03.783088) 21:07:06.885611 run osmo-hlr_10.42.42.2(pid=15111): stderr: | 20221209210703979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210703979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210703979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210703979 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210703979 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210703979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210703991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210704000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210704000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210704000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:06.956570 run osmo-msc_10.42.42.6(pid=15117): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15117)] 21:07:07.005846 run osmo-msc_10.42.42.6(pid=15117): stdout: | (launched: 2022-12-09_21:07:05.817067) 21:07:07.056614 run osmo-msc_10.42.42.6(pid=15117): stderr: | 20221209210706138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210706138 DLGLOBAL DEBUG validating counter group 0x7f285cb26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210706138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210706138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210706138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210706139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210706140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210706141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210706141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210706141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:07.108246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15110): Terminating (SIGTERM) 21:07:07.149522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15113): Terminating (SIGTERM) 21:07:07.190631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15116): Terminating (SIGTERM) 21:07:07.232137 --- ParallelTerminationStrategy: PID 15110 died... 21:07:07.252017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15110): Terminated: ok {rc=0} 21:07:07.297988 --- ParallelTerminationStrategy: PID 15113 died... 21:07:07.317297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15113): Terminated: ok {rc=0} 21:07:07.362602 --- ParallelTerminationStrategy: PID 15116 died... 21:07:07.381837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15116): Terminated: ok {rc=0} 21:07:07.467696 bus /sierra_3: Setting Powered False 21:07:08.565656 bus /sierra_3: Setting Powered False 21:07:09.679965 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:07:10.824592 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:10.836717 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:07:10.896390 tst mo_mt_call_osmux.py: using LAC 23729 21:07:11.016570 tst mo_mt_call_osmux.py: using RAC 14 21:07:11.135186 tst mo_mt_call_osmux.py: using CellId 23729 21:07:11.253834 tst mo_mt_call_osmux.py: using BVCI 23730 21:07:11.366046 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:11.377730 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:11.388872 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:11.400515 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:11.412125 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:07:11.423679 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:11.540371 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:07:11.656023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:12.128265 run create_hlr_db(pid=15120): Launched 21:07:12.242642 bus /sierra_2: Setting Powered False 21:07:13.303363 run create_hlr_db(pid=15120): Terminated: ok {rc=0} 21:07:13.723731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15122): Launched 21:07:14.025413 run osmo-hlr_10.42.42.2(pid=15123): Launched 21:07:14.140851 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:14.675371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15125): Launched 21:07:14.977800 run osmo-stp_10.42.42.5(pid=15126): Launched 21:07:15.093411 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:15.643586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15128): Launched 21:07:15.985345 run osmo-msc_10.42.42.6(pid=15129): Launched 21:07:16.342094 run osmo-stp_10.42.42.5(pid=15126): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15126)] 21:07:16.703251 run osmo-stp_10.42.42.5(pid=15126): stdout: | (launched: 2022-12-09_21:07:14.922450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:16.986133 run osmo-stp_10.42.42.5(pid=15126): stderr: | 20221209210715093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210715093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210715093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210715094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210715094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210715094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210715094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:17.276541 run osmo-stp_10.42.42.5(pid=15126): stdout: | (launched: 2022-12-09_21:07:14.922450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:17.399436 run osmo-stp_10.42.42.5(pid=15126): stderr: | 20221209210715093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210715093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210715093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210715094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210715094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210715094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210715094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:17.544086 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15126): Process ended prematurely: osmo-stp_10.42.42.5(pid=15126) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15126)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:07:17.553345 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 21:07:17.580632 run osmo-hlr_10.42.42.2(pid=15123): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15123)] 21:07:17.628445 run osmo-hlr_10.42.42.2(pid=15123): stdout: | (launched: 2022-12-09_21:07:13.969695) 21:07:17.677833 run osmo-hlr_10.42.42.2(pid=15123): stderr: | 20221209210714146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210714146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210714146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210714146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210714146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210714146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210714157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210714166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210714166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210714166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:17.747141 run osmo-msc_10.42.42.6(pid=15129): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15129)] 21:07:17.794793 run osmo-msc_10.42.42.6(pid=15129): stdout: | (launched: 2022-12-09_21:07:15.924312) 21:07:17.843966 run osmo-msc_10.42.42.6(pid=15129): stderr: | 20221209210716669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210716670 DLGLOBAL DEBUG validating counter group 0x7f9d15a9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210716670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210716670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210716672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210716673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210716682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210716682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210716683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210716684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:17.893635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15122): Terminating (SIGTERM) 21:07:17.933231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15125): Terminating (SIGTERM) 21:07:17.972899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15128): Terminating (SIGTERM) 21:07:18.012811 --- ParallelTerminationStrategy: PID 15122 died... 21:07:18.031847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15122): Terminated: ok {rc=0} 21:07:18.076215 --- ParallelTerminationStrategy: PID 15125 died... 21:07:18.094834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15125): Terminated: ok {rc=0} 21:07:18.138917 --- ParallelTerminationStrategy: PID 15128 died... 21:07:18.157401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15128): Terminated: ok {rc=0} 21:07:18.243158 bus /sierra_3: Setting Powered False 21:07:19.341848 bus /sierra_3: Setting Powered False 21:07:20.456115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:07:21.700430 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:21.708405 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:07:21.733054 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:07:21.760693 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:07:21.814307 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:07:21.839348 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:07:21.866505 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:07:22.419175 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:07:22.470544 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:22.482285 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:22.543355 tst mo_mt_call.py: using LAC 23730 21:07:22.669277 tst mo_mt_call.py: using RAC 15 21:07:22.800268 tst mo_mt_call.py: using CellId 23730 21:07:22.926129 tst mo_mt_call.py: using BVCI 23731 21:07:23.036615 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.048311 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.059738 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.071552 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.083853 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:23.095721 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:23.218786 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:23.341374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:23.841247 run create_hlr_db(pid=15135): Launched 21:07:23.971514 bus /sierra_2: Setting Powered False 21:07:25.032388 run create_hlr_db(pid=15135): Terminated: ok {rc=0} 21:07:25.453108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Launched 21:07:25.754736 run osmo-hlr_10.42.42.2(pid=15138): Launched 21:07:25.871312 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:26.432213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Launched 21:07:26.755072 run osmo-stp_10.42.42.5(pid=15141): Launched 21:07:26.878913 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:27.465818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15143): Launched 21:07:27.794726 run osmo-msc_10.42.42.6(pid=15144): Launched 21:07:27.973269 run osmo-stp_10.42.42.5(pid=15141): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] 21:07:28.108693 run osmo-stp_10.42.42.5(pid=15141): stdout: | (launched: 2022-12-09_21:07:26.696160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:28.244426 run osmo-stp_10.42.42.5(pid=15141): stderr: | 20221209210726891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210726891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210726891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210726892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210726892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210726892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210726892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:28.379428 run osmo-stp_10.42.42.5(pid=15141): stdout: | (launched: 2022-12-09_21:07:26.696160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:28.507785 run osmo-stp_10.42.42.5(pid=15141): stderr: | 20221209210726891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210726891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210726891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210726892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210726892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210726892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210726892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:28.661833 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15141): Process ended prematurely: osmo-stp_10.42.42.5(pid=15141) [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:07:28.671629 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:07:28.699311 run osmo-hlr_10.42.42.2(pid=15138): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15138)] 21:07:28.748485 run osmo-hlr_10.42.42.2(pid=15138): stdout: | (launched: 2022-12-09_21:07:25.699416) 21:07:28.799656 run osmo-hlr_10.42.42.2(pid=15138): stderr: | 20221209210725876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210725876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210725876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210725876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210725876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210725876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210725887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210725895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210725896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210725896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:28.871193 run osmo-msc_10.42.42.6(pid=15144): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15144)] 21:07:28.920643 run osmo-msc_10.42.42.6(pid=15144): stdout: | (launched: 2022-12-09_21:07:27.735543) 21:07:28.971531 run osmo-msc_10.42.42.6(pid=15144): stderr: | 20221209210728059 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210728060 DLGLOBAL DEBUG validating counter group 0x7fb4db03ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210728060 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210728060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210728060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210728060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210728062 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210728062 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210728062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210728062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:29.022635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Terminating (SIGTERM) 21:07:29.063520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Terminating (SIGTERM) 21:07:29.104727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15143): Terminating (SIGTERM) 21:07:29.145992 --- ParallelTerminationStrategy: PID 15137 died... 21:07:29.165417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15137): Terminated: ok {rc=0} 21:07:29.211066 --- ParallelTerminationStrategy: PID 15140 died... 21:07:29.230406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15140): Terminated: ok {rc=0} 21:07:29.275526 --- ParallelTerminationStrategy: PID 15143 died... 21:07:29.294877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15143): Terminated: ok {rc=0} 21:07:29.381245 bus /sierra_3: Setting Powered False 21:07:30.477604 bus /sierra_3: Setting Powered False 21:07:31.588874 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:07:32.739582 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:32.751916 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:07:32.813234 tst mo_mt_call_osmux.py: using LAC 23731 21:07:32.941040 tst mo_mt_call_osmux.py: using RAC 16 21:07:33.067005 tst mo_mt_call_osmux.py: using CellId 23731 21:07:33.195271 tst mo_mt_call_osmux.py: using BVCI 23732 21:07:33.312176 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:33.323919 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:33.335372 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:33.346869 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:33.358601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:07:33.370111 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:33.486134 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:07:33.608810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:34.111612 run create_hlr_db(pid=15146): Launched 21:07:34.242215 bus /sierra_2: Setting Powered False 21:07:35.306740 run create_hlr_db(pid=15146): Terminated: ok {rc=0} 21:07:35.738832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Launched 21:07:36.049410 run osmo-hlr_10.42.42.2(pid=15149): Launched 21:07:36.165801 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:36.690847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Launched 21:07:36.993959 run osmo-stp_10.42.42.5(pid=15152): Launched 21:07:37.109412 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:37.656541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Launched 21:07:37.959893 run osmo-msc_10.42.42.6(pid=15155): Launched 21:07:38.128671 run osmo-stp_10.42.42.5(pid=15152): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] 21:07:38.257241 run osmo-stp_10.42.42.5(pid=15152): stdout: | (launched: 2022-12-09_21:07:36.938412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:38.385120 run osmo-stp_10.42.42.5(pid=15152): stderr: | 20221209210737110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210737110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210737110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210737111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210737111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210737111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210737111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:38.510977 run osmo-stp_10.42.42.5(pid=15152): stdout: | (launched: 2022-12-09_21:07:36.938412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:38.631405 run osmo-stp_10.42.42.5(pid=15152): stderr: | 20221209210737110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210737110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210737110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210737111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210737111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210737111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210737111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:38.775974 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15152): Process ended prematurely: osmo-stp_10.42.42.5(pid=15152) [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:07:38.784885 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 21:07:38.812746 run osmo-hlr_10.42.42.2(pid=15149): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15149)] 21:07:38.860858 run osmo-hlr_10.42.42.2(pid=15149): stdout: | (launched: 2022-12-09_21:07:35.993921) 21:07:38.910443 run osmo-hlr_10.42.42.2(pid=15149): stderr: | 20221209210736168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210736168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210736168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210736169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210736169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210736169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210736180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210736189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210736189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210736189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:38.979597 run osmo-msc_10.42.42.6(pid=15155): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15155)] 21:07:39.027244 run osmo-msc_10.42.42.6(pid=15155): stdout: | (launched: 2022-12-09_21:07:37.903986) 21:07:39.076918 run osmo-msc_10.42.42.6(pid=15155): stderr: | 20221209210738176 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210738176 DLGLOBAL DEBUG validating counter group 0x7efdb6863c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210738177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210738177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210738177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210738177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210738179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210738179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210738179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210738179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:39.126802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Terminating (SIGTERM) 21:07:39.166483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Terminating (SIGTERM) 21:07:39.206231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Terminating (SIGTERM) 21:07:39.246333 --- ParallelTerminationStrategy: PID 15148 died... 21:07:39.265124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15148): Terminated: ok {rc=0} 21:07:39.309179 --- ParallelTerminationStrategy: PID 15151 died... 21:07:39.327479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15151): Terminated: ok {rc=0} 21:07:39.371061 --- ParallelTerminationStrategy: PID 15154 died... 21:07:39.389430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15154): Terminated: ok {rc=0} 21:07:39.472102 bus /sierra_3: Setting Powered False 21:07:40.569809 bus /sierra_3: Setting Powered False 21:07:41.687506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:nanobts+band-1900 --------------------------------------------------------------------- 21:07:42.925969 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:07:42.931021 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:07:42.954666 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 21:07:42.982352 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:07:43.066511 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:07:43.090689 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 21:07:43.117363 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:07:43.700725 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 21:07:43.707326 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:43.718890 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:07:43.759124 tst emergency_mo_mt_call.py: using LAC 23732 21:07:43.885692 tst emergency_mo_mt_call.py: using RAC 17 21:07:44.010906 tst emergency_mo_mt_call.py: using CellId 23732 21:07:44.136372 tst emergency_mo_mt_call.py: using BVCI 23733 21:07:44.253320 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:44.264456 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:44.275761 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:44.287042 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:44.298275 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:44.309435 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:44.427383 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:44.541565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:45.003673 run create_hlr_db(pid=15160): Launched 21:07:45.118595 bus /sierra_2: Setting Powered False 21:07:46.177053 run create_hlr_db(pid=15160): Terminated: ok {rc=0} 21:07:46.609740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15162): Launched 21:07:46.932401 run osmo-hlr_10.42.42.2(pid=15163): Launched 21:07:47.169076 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:47.730639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15165): Launched 21:07:48.050265 run osmo-stp_10.42.42.5(pid=15166): Launched 21:07:48.183130 tst emergency_mo_mt_call.py: using MSISDN 7376 21:07:48.346293 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:48.922251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15168): Launched 21:07:49.241270 run osmo-msc_10.42.42.6(pid=15169): Launched 21:07:49.418793 run osmo-stp_10.42.42.5(pid=15166): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15166)] 21:07:49.552343 run osmo-stp_10.42.42.5(pid=15166): stdout: | (launched: 2022-12-09_21:07:47.992167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:49.687134 run osmo-stp_10.42.42.5(pid=15166): stderr: | 20221209210748182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210748182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210748182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210748183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210748183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210748183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210748183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:49.821296 run osmo-stp_10.42.42.5(pid=15166): stdout: | (launched: 2022-12-09_21:07:47.992167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:07:49.948444 run osmo-stp_10.42.42.5(pid=15166): stderr: | 20221209210748182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210748182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210748182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210748183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210748183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210748183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210748183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:07:50.100223 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15166): Process ended prematurely: osmo-stp_10.42.42.5(pid=15166) [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15166)] [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 21:07:50.109882 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 21:07:50.137066 run osmo-hlr_10.42.42.2(pid=15163): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15163)] 21:07:50.186850 run osmo-hlr_10.42.42.2(pid=15163): stdout: | (launched: 2022-12-09_21:07:46.862516) 21:07:50.238060 run osmo-hlr_10.42.42.2(pid=15163): stderr: | 20221209210747088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210747088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210747089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210747089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210747089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210747089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210747106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210747126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210747127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210747127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:07:50.309733 run osmo-msc_10.42.42.6(pid=15169): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15169)] 21:07:50.359223 run osmo-msc_10.42.42.6(pid=15169): stdout: | (launched: 2022-12-09_21:07:49.182471) 21:07:50.410178 run osmo-msc_10.42.42.6(pid=15169): stderr: | 20221209210749504 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210749504 DLGLOBAL DEBUG validating counter group 0x7fb3796cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210749504 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210749504 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210749505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210749505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210749506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210749507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210749507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210749507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:07:50.461567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15162): Terminating (SIGTERM) 21:07:50.502980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15165): Terminating (SIGTERM) 21:07:50.544679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15168): Terminating (SIGTERM) 21:07:50.587112 --- ParallelTerminationStrategy: PID 15162 died... 21:07:50.607034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15162): Terminated: ok {rc=0} 21:07:50.653108 --- ParallelTerminationStrategy: PID 15165 died... 21:07:50.672570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15165): Terminated: ok {rc=0} 21:07:50.718308 --- ParallelTerminationStrategy: PID 15168 died... 21:07:50.737819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15168): Terminated: ok {rc=0} 21:07:50.825555 bus /sierra_3: Setting Powered False 21:07:51.925298 bus /sierra_3: Setting Powered False 21:07:53.042517 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 21:07:54.129457 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.141106 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:07:54.182202 tst emergency_preemptive_call.py: using LAC 23733 21:07:54.300752 tst emergency_preemptive_call.py: using RAC 18 21:07:54.417197 tst emergency_preemptive_call.py: using CellId 23733 21:07:54.535672 tst emergency_preemptive_call.py: using BVCI 23734 21:07:54.645156 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.655836 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.666580 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.677485 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.688289 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 21:07:54.699120 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:54.819574 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:54.937739 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:55.055334 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:07:55.169610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:07:55.634445 run create_hlr_db(pid=15171): Launched 21:07:55.748324 bus /sierra_2: Setting Powered False 21:07:56.808312 run create_hlr_db(pid=15171): Terminated: ok {rc=0} 21:07:57.245472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Launched 21:07:57.563954 run osmo-hlr_10.42.42.2(pid=15174): Launched 21:07:57.685347 run osmo-stp_10.42.42.5: Starting osmo-stp 21:07:58.236433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Launched 21:07:58.553532 run osmo-stp_10.42.42.5(pid=15177): Launched 21:07:58.684509 tst emergency_preemptive_call.py: using MSISDN 7377 21:07:58.847021 run osmo-msc_10.42.42.6: Starting osmo-msc 21:07:59.420796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Launched 21:07:59.739720 run osmo-msc_10.42.42.6(pid=15180): Launched 21:07:59.917164 run osmo-stp_10.42.42.5(pid=15177): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] 21:08:00.051508 run osmo-stp_10.42.42.5(pid=15177): stdout: | (launched: 2022-12-09_21:07:58.495219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:00.187208 run osmo-stp_10.42.42.5(pid=15177): stderr: | 20221209210758687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210758688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210758688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210758688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210758689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210758689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210758689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:00.321517 run osmo-stp_10.42.42.5(pid=15177): stdout: | (launched: 2022-12-09_21:07:58.495219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:00.448533 run osmo-stp_10.42.42.5(pid=15177): stderr: | 20221209210758687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210758688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210758688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210758688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210758689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210758689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210758689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:00.600810 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15177): Process ended prematurely: osmo-stp_10.42.42.5(pid=15177) [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 21:08:00.610004 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 21:08:00.637850 run osmo-hlr_10.42.42.2(pid=15174): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15174)] 21:08:00.687734 run osmo-hlr_10.42.42.2(pid=15174): stdout: | (launched: 2022-12-09_21:07:57.505775) 21:08:00.739366 run osmo-hlr_10.42.42.2(pid=15174): stderr: | 20221209210757703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210757703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210757703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210757703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210757703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210757703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210757715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210757723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210757723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210757724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:00.811312 run osmo-msc_10.42.42.6(pid=15180): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15180)] 21:08:00.876117 run osmo-msc_10.42.42.6(pid=15180): stdout: | (launched: 2022-12-09_21:07:59.681124) 21:08:00.934295 run osmo-msc_10.42.42.6(pid=15180): stderr: | 20221209210800002 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209210800002 DLGLOBAL DEBUG validating counter group 0x7f5b59fc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209210800003 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209210800003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209210800003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209210800003 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209210800005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209210800005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209210800005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209210800005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:08:00.986993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Terminating (SIGTERM) 21:08:01.029523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Terminating (SIGTERM) 21:08:01.072597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Terminating (SIGTERM) 21:08:01.117293 --- ParallelTerminationStrategy: PID 15173 died... 21:08:01.137535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15173): Terminated: ok {rc=0} 21:08:01.184646 --- ParallelTerminationStrategy: PID 15176 died... 21:08:01.204922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15176): Terminated: ok {rc=0} 21:08:01.251604 --- ParallelTerminationStrategy: PID 15179 died... 21:08:01.271691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15179): Terminated: ok {rc=0} 21:08:01.361085 bus /sierra_9: Setting Powered False 21:08:02.466664 bus /sierra_9: Setting Powered False 21:08:03.584796 bus /sierra_8: Setting Powered False 21:08:04.686261 bus /sierra_8: Setting Powered False 21:08:05.805998 bus /sierra_3: Setting Powered False 21:08:06.908832 bus /sierra_3: Setting Powered False 21:08:08.044526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900 --------------------------------------------------------------------- 21:08:09.384534 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:08:09.394454 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 21:08:09.427655 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 21:08:09.475256 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 21:08:09.575532 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 21:08:09.618560 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 21:08:09.677596 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 21:08:10.232858 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 21:08:10.289946 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.301750 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:10.345263 tst cs_paging_gprs_active.py: using LAC 23734 21:08:10.474999 tst cs_paging_gprs_active.py: using RAC 19 21:08:10.602180 tst cs_paging_gprs_active.py: using CellId 23734 21:08:10.731540 tst cs_paging_gprs_active.py: using BVCI 23735 21:08:10.853431 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.865895 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.877924 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.890173 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.902772 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.914702 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.927312 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.939619 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:10.953087 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:11.079836 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:11.205418 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:08:11.432754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:11.771290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15457): Launched 21:08:12.075841 run iperf3-srv_10.42.42.10(pid=15458): Launched 21:08:12.215596 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:08:12.444217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:12.782562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15459): Launched 21:08:13.087630 run iperf3-srv_10.42.42.10(pid=15460): Launched 21:08:13.226706 tst cs_paging_gprs_active.py:38: start network... 21:08:13.455293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:13.976817 run create_hlr_db(pid=15461): Launched 21:08:14.147834 bus /sierra_2: Setting Powered False 21:08:15.213889 run create_hlr_db(pid=15461): Terminated: ok {rc=0} 21:08:15.685875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Launched 21:08:16.033740 run osmo-hlr_10.42.42.2(pid=15464): Launched 21:08:16.284280 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:16.977718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Launched 21:08:17.325302 run osmo-stp_10.42.42.5(pid=15467): Launched 21:08:17.572596 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:18.384163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15469): Launched 21:08:18.514379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:18.778344 run patchelf(pid=15470): Launched 21:08:18.965309 run osmo-stp_10.42.42.5(pid=15467): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] 21:08:19.097433 run osmo-stp_10.42.42.5(pid=15467): stdout: | (launched: 2022-12-09_21:08:17.263083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:19.231676 run osmo-stp_10.42.42.5(pid=15467): stderr: | 20221209210817644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210817644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210817644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210817645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210817645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210817645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210817646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:19.366729 run osmo-stp_10.42.42.5(pid=15467): stdout: | (launched: 2022-12-09_21:08:17.263083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:19.495028 run osmo-stp_10.42.42.5(pid=15467): stderr: | 20221209210817644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210817644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210817644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210817645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210817645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210817645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210817646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:19.647097 run patchelf(pid=15470): Terminating (SIGINT) 21:08:19.822912 run patchelf(pid=15470): Terminated: ok {rc=0} 21:08:19.950138 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15467): Process ended prematurely: osmo-stp_10.42.42.5(pid=15467) [trial-2364↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] [trial-2364↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 21:08:19.960745 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 21:08:19.991899 run osmo-hlr_10.42.42.2(pid=15464): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15464)] 21:08:20.042640 run osmo-hlr_10.42.42.2(pid=15464): stdout: | (launched: 2022-12-09_21:08:15.971536) 21:08:20.094850 run osmo-hlr_10.42.42.2(pid=15464): stderr: | 20221209210816314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210816315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210816315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210816315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210816315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210816315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210816339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210816358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210816358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210816358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:20.147836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15457): Terminating (SIGTERM) 21:08:20.190664 run iperf3-srv_10.42.42.10(pid=15458): Terminating (SIGTERM) 21:08:20.236293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15459): Terminating (SIGTERM) 21:08:20.279742 run iperf3-srv_10.42.42.10(pid=15460): Terminating (SIGTERM) 21:08:20.325584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Terminating (SIGTERM) 21:08:20.368819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Terminating (SIGTERM) 21:08:20.413513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15469): Terminating (SIGTERM) 21:08:20.458613 --- ParallelTerminationStrategy: PID 15457 died... 21:08:20.478754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15457): Terminated: ok {rc=0} 21:08:20.527703 --- ParallelTerminationStrategy: PID 15458 died... 21:08:20.547165 run iperf3-srv_10.42.42.10(pid=15458): Terminated {rc=256} 21:08:20.594687 --- ParallelTerminationStrategy: PID 15459 died... 21:08:20.614434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15459): Terminated: ok {rc=0} 21:08:20.661707 --- ParallelTerminationStrategy: PID 15460 died... 21:08:20.681377 run iperf3-srv_10.42.42.10(pid=15460): Terminated {rc=256} 21:08:20.728791 --- ParallelTerminationStrategy: PID 15463 died... 21:08:20.748519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15463): Terminated: ok {rc=0} 21:08:20.795867 --- ParallelTerminationStrategy: PID 15466 died... 21:08:20.815647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15466): Terminated: ok {rc=0} 21:08:20.862723 --- ParallelTerminationStrategy: PID 15469 died... 21:08:20.882531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15469): Terminated: ok {rc=0} 21:08:20.971385 bus /gobi_0: Setting Powered False 21:08:22.071897 bus /gobi_0: Setting Powered False 21:08:23.188276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 21:08:24.341683 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.354115 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:24.395879 tst iperf3.py: using LAC 23735 21:08:24.524026 tst iperf3.py: using RAC 20 21:08:24.651477 tst iperf3.py: using CellId 23735 21:08:24.780053 tst iperf3.py: using BVCI 23736 21:08:24.898192 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.909398 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.920481 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.931595 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.942555 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.953496 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.964573 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.975682 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:24.986881 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:25.106131 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:25.309802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:25.614641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15471): Launched 21:08:25.879316 run iperf3-srv_10.42.42.10(pid=15472): Launched 21:08:25.993331 tst iperf3.py:8: start network... 21:08:26.197666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:26.668767 run create_hlr_db(pid=15473): Launched 21:08:26.784802 bus /gobi_6: Setting Powered False 21:08:27.845652 run create_hlr_db(pid=15473): Terminated: ok {rc=0} 21:08:28.270139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15475): Launched 21:08:28.574693 run osmo-hlr_10.42.42.2(pid=15476): Launched 21:08:28.690952 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:29.230177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15478): Launched 21:08:29.534823 run osmo-stp_10.42.42.5(pid=15479): Launched 21:08:29.650380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:30.176594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15481): Launched 21:08:30.293247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:30.551500 run patchelf(pid=15482): Launched 21:08:30.722202 run osmo-stp_10.42.42.5(pid=15479): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15479)] 21:08:30.869837 run osmo-stp_10.42.42.5(pid=15479): stdout: | (launched: 2022-12-09_21:08:29.478254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:31.017734 run osmo-stp_10.42.42.5(pid=15479): stderr: | 20221209210829648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210829648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210829648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210829648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210829651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210829651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210829651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:31.162338 run osmo-stp_10.42.42.5(pid=15479): stdout: | (launched: 2022-12-09_21:08:29.478254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:31.299900 run osmo-stp_10.42.42.5(pid=15479): stderr: | 20221209210829648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210829648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210829648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210829648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210829651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210829651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210829651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:31.477725 run patchelf(pid=15482): Terminating (SIGINT) 21:08:31.704375 run patchelf(pid=15482): Terminated: ok {rc=0} 21:08:31.871286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15479): Process ended prematurely: osmo-stp_10.42.42.5(pid=15479) [trial-2364↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15479)] [trial-2364↪gprs:nanobts+band-1900↪iperf3.py:8] 21:08:31.893809 tst iperf3.py:8: Test FAILED (7.6 sec) 21:08:31.927808 run osmo-hlr_10.42.42.2(pid=15476): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15476)] 21:08:31.982922 run osmo-hlr_10.42.42.2(pid=15476): stdout: | (launched: 2022-12-09_21:08:28.518374) 21:08:32.045519 run osmo-hlr_10.42.42.2(pid=15476): stderr: | 20221209210828699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210828699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210828699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210828699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210828699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210828699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210828711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210828720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210828720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210828720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:32.109677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15471): Terminating (SIGTERM) 21:08:32.161482 run iperf3-srv_10.42.42.10(pid=15472): Terminating (SIGTERM) 21:08:32.211516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15475): Terminating (SIGTERM) 21:08:32.258213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15478): Terminating (SIGTERM) 21:08:32.300474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15481): Terminating (SIGTERM) 21:08:32.342989 --- ParallelTerminationStrategy: PID 15471 died... 21:08:32.362286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15471): Terminated: ok {rc=0} 21:08:32.407036 --- ParallelTerminationStrategy: PID 15472 died... 21:08:32.425769 run iperf3-srv_10.42.42.10(pid=15472): Terminated {rc=256} 21:08:32.470248 --- ParallelTerminationStrategy: PID 15475 died... 21:08:32.488895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15475): Terminated: ok {rc=0} 21:08:32.533342 --- ParallelTerminationStrategy: PID 15478 died... 21:08:32.552061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15478): Terminated: ok {rc=0} 21:08:32.596247 --- ParallelTerminationStrategy: PID 15481 died... 21:08:32.615076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15481): Terminated: ok {rc=0} 21:08:32.700665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 21:08:33.846630 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:33.858209 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:33.901423 tst iperf3m4.py: using LAC 23736 21:08:34.019886 tst iperf3m4.py: using RAC 21 21:08:34.137620 tst iperf3m4.py: using CellId 23736 21:08:34.255243 tst iperf3m4.py: using BVCI 23737 21:08:34.365679 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.376238 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.386869 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.397966 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.408868 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.419860 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.430966 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.442068 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:34.453373 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:34.570944 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:34.692508 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:34.813979 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:34.928178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:08:35.132494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:35.439974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15483): Launched 21:08:35.704916 run iperf3-srv_10.42.42.10(pid=15484): Launched 21:08:35.818265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:08:36.022654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:36.328271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15485): Launched 21:08:36.594437 run iperf3-srv_10.42.42.10(pid=15486): Launched 21:08:36.708032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:08:36.911721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:37.218343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15487): Launched 21:08:37.483102 run iperf3-srv_10.42.42.10(pid=15488): Launched 21:08:37.596940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:08:37.800918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:08:38.107245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15489): Launched 21:08:38.371604 run iperf3-srv_10.42.42.10(pid=15490): Launched 21:08:38.485465 tst iperf3m4.py:8: start network... 21:08:38.689379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:39.160032 run create_hlr_db(pid=15491): Launched 21:08:39.275668 bus /gobi_6: Setting Powered False 21:08:40.335845 run create_hlr_db(pid=15491): Terminated: ok {rc=0} 21:08:40.759787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Launched 21:08:41.065926 run osmo-hlr_10.42.42.2(pid=15494): Launched 21:08:41.182727 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:41.710289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Launched 21:08:42.015420 run osmo-stp_10.42.42.5(pid=15497): Launched 21:08:42.131838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:42.655654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15499): Launched 21:08:42.771367 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:43.029634 run patchelf(pid=15500): Launched 21:08:43.200267 run osmo-stp_10.42.42.5(pid=15497): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] 21:08:43.329264 run osmo-stp_10.42.42.5(pid=15497): stdout: | (launched: 2022-12-09_21:08:41.958569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:43.459401 run osmo-stp_10.42.42.5(pid=15497): stderr: | 20221209210842125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210842125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210842126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210842126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210842127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210842127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210842127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:43.589787 run osmo-stp_10.42.42.5(pid=15497): stdout: | (launched: 2022-12-09_21:08:41.958569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:43.714441 run osmo-stp_10.42.42.5(pid=15497): stderr: | 20221209210842125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210842125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210842126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210842126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210842127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210842127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210842127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:43.862160 run patchelf(pid=15500): Terminating (SIGINT) 21:08:44.032585 run patchelf(pid=15500): Terminated: ok {rc=0} 21:08:44.155700 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15497): Process ended prematurely: osmo-stp_10.42.42.5(pid=15497) [trial-2364↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] [trial-2364↪gprs:nanobts+band-1900↪iperf3m4.py:8] 21:08:44.165370 tst iperf3m4.py:8: Test FAILED (10.4 sec) 21:08:44.192848 run osmo-hlr_10.42.42.2(pid=15494): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15494)] 21:08:44.240719 run osmo-hlr_10.42.42.2(pid=15494): stdout: | (launched: 2022-12-09_21:08:41.008015) 21:08:44.289827 run osmo-hlr_10.42.42.2(pid=15494): stderr: | 20221209210841184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210841184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210841184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210841184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210841184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210841185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210841196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210841205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210841206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210841206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:44.339491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15483): Terminating (SIGTERM) 21:08:44.379263 run iperf3-srv_10.42.42.10(pid=15484): Terminating (SIGTERM) 21:08:44.418788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15485): Terminating (SIGTERM) 21:08:44.458365 run iperf3-srv_10.42.42.10(pid=15486): Terminating (SIGTERM) 21:08:44.497714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15487): Terminating (SIGTERM) 21:08:44.537503 run iperf3-srv_10.42.42.10(pid=15488): Terminating (SIGTERM) 21:08:44.577034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15489): Terminating (SIGTERM) 21:08:44.616594 run iperf3-srv_10.42.42.10(pid=15490): Terminating (SIGTERM) 21:08:44.656077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Terminating (SIGTERM) 21:08:44.695636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Terminating (SIGTERM) 21:08:44.735103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15499): Terminating (SIGTERM) 21:08:44.774947 --- ParallelTerminationStrategy: PID 15483 died... 21:08:44.794029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15483): Terminated: ok {rc=0} 21:08:44.838574 --- ParallelTerminationStrategy: PID 15484 died... 21:08:44.857292 run iperf3-srv_10.42.42.10(pid=15484): Terminated {rc=256} 21:08:44.901327 --- ParallelTerminationStrategy: PID 15485 died... 21:08:44.919968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15485): Terminated: ok {rc=0} 21:08:44.964109 --- ParallelTerminationStrategy: PID 15486 died... 21:08:44.982823 run iperf3-srv_10.42.42.10(pid=15486): Terminated {rc=256} 21:08:45.026721 --- ParallelTerminationStrategy: PID 15487 died... 21:08:45.045397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15487): Terminated: ok {rc=0} 21:08:45.089479 --- ParallelTerminationStrategy: PID 15488 died... 21:08:45.108141 run iperf3-srv_10.42.42.10(pid=15488): Terminated {rc=256} 21:08:45.152161 --- ParallelTerminationStrategy: PID 15489 died... 21:08:45.170894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15489): Terminated: ok {rc=0} 21:08:45.215048 --- ParallelTerminationStrategy: PID 15490 died... 21:08:45.233998 run iperf3-srv_10.42.42.10(pid=15490): Terminated {rc=256} 21:08:45.278138 --- ParallelTerminationStrategy: PID 15493 died... 21:08:45.296769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Terminated: ok {rc=0} 21:08:45.341149 --- ParallelTerminationStrategy: PID 15496 died... 21:08:45.359819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Terminated: ok {rc=0} 21:08:45.403568 --- ParallelTerminationStrategy: PID 15499 died... 21:08:45.422327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15499): Terminated: ok {rc=0} 21:08:45.508232 bus /gobi_4: Setting Powered False 21:08:46.607876 bus /gobi_4: Setting Powered False 21:08:47.741542 bus /gobi_1: Setting Powered False 21:08:48.838753 bus /gobi_1: Setting Powered False 21:08:49.954278 bus /gobi_0: Setting Powered False 21:08:51.051244 bus /gobi_0: Setting Powered False 21:08:52.168015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 21:08:53.270746 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.282738 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:08:53.323093 tst ping.py: using LAC 23737 21:08:53.449754 tst ping.py: using RAC 22 21:08:53.575795 tst ping.py: using CellId 23737 21:08:53.700760 tst ping.py: using BVCI 23738 21:08:53.816282 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.827492 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.838580 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.849574 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.860426 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.871902 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.883133 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:08:53.894416 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:08:54.012521 tst ping.py:19: start network... 21:08:54.227273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:08:54.721454 run create_hlr_db(pid=15502): Launched 21:08:54.849834 bus /gobi_6: Setting Powered False 21:08:55.912781 run create_hlr_db(pid=15502): Terminated: ok {rc=0} 21:08:56.337806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15504): Launched 21:08:56.636578 run osmo-hlr_10.42.42.2(pid=15505): Launched 21:08:56.750252 run osmo-stp_10.42.42.5: Starting osmo-stp 21:08:57.268731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15507): Launched 21:08:57.569129 run osmo-stp_10.42.42.5(pid=15508): Launched 21:08:57.683817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:08:58.199211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15510): Launched 21:08:58.312935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:08:58.565200 run patchelf(pid=15511): Launched 21:08:58.730215 run osmo-stp_10.42.42.5(pid=15508): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15508)] 21:08:58.856278 run osmo-stp_10.42.42.5(pid=15508): stdout: | (launched: 2022-12-09_21:08:57.513473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:58.984169 run osmo-stp_10.42.42.5(pid=15508): stderr: | 20221209210857684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210857684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210857684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210857685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210857685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210857685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210857685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:59.111917 run osmo-stp_10.42.42.5(pid=15508): stdout: | (launched: 2022-12-09_21:08:57.513473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:08:59.233780 run osmo-stp_10.42.42.5(pid=15508): stderr: | 20221209210857684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210857684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210857684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210857685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210857685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210857685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210857685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:08:59.379022 run patchelf(pid=15511): Terminating (SIGINT) 21:08:59.546229 run patchelf(pid=15511): Terminated: ok {rc=0} 21:08:59.666739 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15508): Process ended prematurely: osmo-stp_10.42.42.5(pid=15508) [trial-2364↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15508)] [trial-2364↪gprs:nanobts+band-1900↪ping.py:22] 21:08:59.675759 tst ping.py:22: Test FAILED (6.4 sec) 21:08:59.702920 run osmo-hlr_10.42.42.2(pid=15505): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15505)] 21:08:59.750698 run osmo-hlr_10.42.42.2(pid=15505): stdout: | (launched: 2022-12-09_21:08:56.581328) 21:08:59.799983 run osmo-hlr_10.42.42.2(pid=15505): stderr: | 20221209210856760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210856760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210856760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210856760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210856760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210856760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210856773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210856783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210856784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210856784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:08:59.849546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15504): Terminating (SIGTERM) 21:08:59.889224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15507): Terminating (SIGTERM) 21:08:59.928884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15510): Terminating (SIGTERM) 21:08:59.968774 --- ParallelTerminationStrategy: PID 15504 died... 21:08:59.988015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15504): Terminated: ok {rc=0} 21:09:00.032013 --- ParallelTerminationStrategy: PID 15507 died... 21:09:00.050635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15507): Terminated: ok {rc=0} 21:09:00.094581 --- ParallelTerminationStrategy: PID 15510 died... 21:09:00.113249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15510): Terminated: ok {rc=0} 21:09:00.199090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 21:09:01.286664 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.299291 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 21:09:01.342197 tst ping_idle_ping.py: using LAC 23738 21:09:01.500890 tst ping_idle_ping.py: using RAC 23 21:09:01.626209 tst ping_idle_ping.py: using CellId 23738 21:09:01.785290 tst ping_idle_ping.py: using BVCI 23739 21:09:01.906885 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.918714 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.930718 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.943796 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.955331 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.967468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.980493 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 21:09:01.992263 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 21:09:02.111469 tst ping_idle_ping.py:24: start network... 21:09:02.316732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:02.783953 run create_hlr_db(pid=15512): Launched 21:09:02.898943 bus /gobi_6: Setting Powered False 21:09:03.958963 run create_hlr_db(pid=15512): Terminated: ok {rc=0} 21:09:04.399374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15514): Launched 21:09:04.721345 run osmo-hlr_10.42.42.2(pid=15515): Launched 21:09:04.843938 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:05.398530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15517): Launched 21:09:05.719871 run osmo-stp_10.42.42.5(pid=15518): Launched 21:09:05.842286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:06.398164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15520): Launched 21:09:06.520283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:06.792222 run patchelf(pid=15521): Launched 21:09:06.972192 run osmo-stp_10.42.42.5(pid=15518): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15518)] 21:09:07.108449 run osmo-stp_10.42.42.5(pid=15518): stdout: | (launched: 2022-12-09_21:09:05.660735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:07.247138 run osmo-stp_10.42.42.5(pid=15518): stderr: | 20221209210905851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210905851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210905852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210905852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210905854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210905855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210905855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:07.385259 run osmo-stp_10.42.42.5(pid=15518): stdout: | (launched: 2022-12-09_21:09:05.660735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:07.517537 run osmo-stp_10.42.42.5(pid=15518): stderr: | 20221209210905851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210905851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210905852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210905852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210905854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210905855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210905855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:07.673971 run patchelf(pid=15521): Terminating (SIGINT) 21:09:07.854873 run patchelf(pid=15521): Terminated: ok {rc=0} 21:09:07.984494 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15518): Process ended prematurely: osmo-stp_10.42.42.5(pid=15518) [trial-2364↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15518)] [trial-2364↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 21:09:07.994260 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:09:08.022516 run osmo-hlr_10.42.42.2(pid=15515): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15515)] 21:09:08.072298 run osmo-hlr_10.42.42.2(pid=15515): stdout: | (launched: 2022-12-09_21:09:04.661901) 21:09:08.123752 run osmo-hlr_10.42.42.2(pid=15515): stderr: | 20221209210904863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210904863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210904863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210904863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210904863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210904863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210904877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210904887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210904887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210904887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:08.175752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15514): Terminating (SIGTERM) 21:09:08.217221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15517): Terminating (SIGTERM) 21:09:08.258839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15520): Terminating (SIGTERM) 21:09:08.300782 --- ParallelTerminationStrategy: PID 15514 died... 21:09:08.320865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15514): Terminated: ok {rc=0} 21:09:08.367240 --- ParallelTerminationStrategy: PID 15517 died... 21:09:08.387019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15517): Terminated: ok {rc=0} 21:09:08.432834 --- ParallelTerminationStrategy: PID 15520 died... 21:09:08.452737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15520): Terminated: ok {rc=0} 21:09:08.540713 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 21:09:09.830666 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:09:09.836605 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:09:09.860332 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:09:09.898391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:09:09.985948 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:09:10.009297 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:09:10.047407 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:09:10.641366 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:09:10.690387 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:10.701269 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:10.741154 tst cs_paging_gprs_active.py: using LAC 23739 21:09:10.862175 tst cs_paging_gprs_active.py: using RAC 24 21:09:10.982233 tst cs_paging_gprs_active.py: using CellId 23739 21:09:11.102869 tst cs_paging_gprs_active.py: using BVCI 23740 21:09:11.215101 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.226088 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.236731 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.247595 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.258461 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.269376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.280348 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.291102 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:11.302177 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:11.423569 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:11.543847 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:09:11.764730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:12.092047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15526): Launched 21:09:12.374788 run iperf3-srv_10.42.42.10(pid=15527): Launched 21:09:12.498581 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:09:12.718896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:13.045995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15528): Launched 21:09:13.330498 run iperf3-srv_10.42.42.10(pid=15529): Launched 21:09:13.453421 tst cs_paging_gprs_active.py:38: start network... 21:09:13.673578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:14.179224 run create_hlr_db(pid=15530): Launched 21:09:14.312114 bus /gobi_6: Setting Powered False 21:09:15.377039 run create_hlr_db(pid=15530): Terminated: ok {rc=0} 21:09:15.829321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15532): Launched 21:09:16.212251 run osmo-hlr_10.42.42.2(pid=15533): Launched 21:09:16.401720 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:17.106564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15535): Launched 21:09:17.445271 run osmo-stp_10.42.42.5(pid=15536): Launched 21:09:17.569656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:18.131228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15538): Launched 21:09:18.255414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:18.530691 run patchelf(pid=15539): Launched 21:09:18.711964 run osmo-stp_10.42.42.5(pid=15536): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15536)] 21:09:18.849625 run osmo-stp_10.42.42.5(pid=15536): stdout: | (launched: 2022-12-09_21:09:17.385042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:18.988196 run osmo-stp_10.42.42.5(pid=15536): stderr: | 20221209210917580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210917580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210917580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210917580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210917581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210917581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210917581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:19.126969 run osmo-stp_10.42.42.5(pid=15536): stdout: | (launched: 2022-12-09_21:09:17.385042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:19.260280 run osmo-stp_10.42.42.5(pid=15536): stderr: | 20221209210917580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210917580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210917580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210917580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210917581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210917581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210917581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:19.418022 run patchelf(pid=15539): Terminating (SIGINT) 21:09:19.599830 run patchelf(pid=15539): Terminated: ok {rc=0} 21:09:19.730685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15536): Process ended prematurely: osmo-stp_10.42.42.5(pid=15536) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15536)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:09:19.741118 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 21:09:19.769725 run osmo-hlr_10.42.42.2(pid=15533): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15533)] 21:09:19.819471 run osmo-hlr_10.42.42.2(pid=15533): stdout: | (launched: 2022-12-09_21:09:16.146580) 21:09:19.870772 run osmo-hlr_10.42.42.2(pid=15533): stderr: | 20221209210916484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210916484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210916484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210916484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210916484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210916484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210916503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210916519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210916520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210916520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:19.922679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15526): Terminating (SIGTERM) 21:09:19.964025 run iperf3-srv_10.42.42.10(pid=15527): Terminating (SIGTERM) 21:09:20.005583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15528): Terminating (SIGTERM) 21:09:20.047285 run iperf3-srv_10.42.42.10(pid=15529): Terminating (SIGTERM) 21:09:20.088635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15532): Terminating (SIGTERM) 21:09:20.130239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15535): Terminating (SIGTERM) 21:09:20.172027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15538): Terminating (SIGTERM) 21:09:20.213965 --- ParallelTerminationStrategy: PID 15526 died... 21:09:20.233939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15526): Terminated: ok {rc=0} 21:09:20.279592 --- ParallelTerminationStrategy: PID 15527 died... 21:09:20.299048 run iperf3-srv_10.42.42.10(pid=15527): Terminated {rc=256} 21:09:20.345396 --- ParallelTerminationStrategy: PID 15528 died... 21:09:20.364723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15528): Terminated: ok {rc=0} 21:09:20.410629 --- ParallelTerminationStrategy: PID 15529 died... 21:09:20.430069 run iperf3-srv_10.42.42.10(pid=15529): Terminated {rc=256} 21:09:20.475657 --- ParallelTerminationStrategy: PID 15532 died... 21:09:20.495242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15532): Terminated: ok {rc=0} 21:09:20.540924 --- ParallelTerminationStrategy: PID 15535 died... 21:09:20.560715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15535): Terminated: ok {rc=0} 21:09:20.606587 --- ParallelTerminationStrategy: PID 15538 died... 21:09:20.626139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15538): Terminated: ok {rc=0} 21:09:20.713464 bus /gobi_0: Setting Powered False 21:09:21.812253 bus /gobi_0: Setting Powered False 21:09:22.928376 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:09:24.077857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.090153 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:24.141331 tst iperf3.py: using LAC 23740 21:09:24.267091 tst iperf3.py: using RAC 25 21:09:24.393278 tst iperf3.py: using CellId 23740 21:09:24.518108 tst iperf3.py: using BVCI 23741 21:09:24.628577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.639508 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.650300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.661420 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.672259 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.683841 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.695018 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.705965 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:24.716843 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:24.836402 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:25.056814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:25.386098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15540): Launched 21:09:25.670475 run iperf3-srv_10.42.42.10(pid=15541): Launched 21:09:25.794362 tst iperf3.py:8: start network... 21:09:26.014926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:26.522768 run create_hlr_db(pid=15542): Launched 21:09:26.654789 bus /gobi_6: Setting Powered False 21:09:27.715759 run create_hlr_db(pid=15542): Terminated: ok {rc=0} 21:09:28.148362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15544): Launched 21:09:28.455284 run osmo-hlr_10.42.42.2(pid=15545): Launched 21:09:28.571811 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:29.115978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15547): Launched 21:09:29.422760 run osmo-stp_10.42.42.5(pid=15548): Launched 21:09:29.539409 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:30.066392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15550): Launched 21:09:30.182440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:30.440780 run patchelf(pid=15551): Launched 21:09:30.610345 run osmo-stp_10.42.42.5(pid=15548): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15548)] 21:09:30.739495 run osmo-stp_10.42.42.5(pid=15548): stdout: | (launched: 2022-12-09_21:09:29.365758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:30.876186 run osmo-stp_10.42.42.5(pid=15548): stderr: | 20221209210929536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210929536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210929537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210929537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210929539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210929540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210929540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:31.017230 run osmo-stp_10.42.42.5(pid=15548): stdout: | (launched: 2022-12-09_21:09:29.365758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:31.144719 run osmo-stp_10.42.42.5(pid=15548): stderr: | 20221209210929536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210929536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210929537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210929537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210929539 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210929540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210929540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:31.295574 run patchelf(pid=15551): Terminating (SIGINT) 21:09:31.470385 run patchelf(pid=15551): Terminated: ok {rc=0} 21:09:31.597223 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15548): Process ended prematurely: osmo-stp_10.42.42.5(pid=15548) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15548)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 21:09:31.607512 tst iperf3.py:8: Test FAILED (7.6 sec) 21:09:31.636621 run osmo-hlr_10.42.42.2(pid=15545): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15545)] 21:09:31.686292 run osmo-hlr_10.42.42.2(pid=15545): stdout: | (launched: 2022-12-09_21:09:28.399172) 21:09:31.738044 run osmo-hlr_10.42.42.2(pid=15545): stderr: | 20221209210928578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210928578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210928578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210928578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210928578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210928578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210928590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210928599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210928599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210928599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:31.790568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15540): Terminating (SIGTERM) 21:09:31.833430 run iperf3-srv_10.42.42.10(pid=15541): Terminating (SIGTERM) 21:09:31.878305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15544): Terminating (SIGTERM) 21:09:31.920696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15547): Terminating (SIGTERM) 21:09:31.961928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15550): Terminating (SIGTERM) 21:09:32.003582 --- ParallelTerminationStrategy: PID 15540 died... 21:09:32.023072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15540): Terminated: ok {rc=0} 21:09:32.069104 --- ParallelTerminationStrategy: PID 15541 died... 21:09:32.088274 run iperf3-srv_10.42.42.10(pid=15541): Terminated {rc=256} 21:09:32.133995 --- ParallelTerminationStrategy: PID 15544 died... 21:09:32.153357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15544): Terminated: ok {rc=0} 21:09:32.199326 --- ParallelTerminationStrategy: PID 15547 died... 21:09:32.218575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15547): Terminated: ok {rc=0} 21:09:32.263817 --- ParallelTerminationStrategy: PID 15550 died... 21:09:32.282355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15550): Terminated: ok {rc=0} 21:09:32.367778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:09:33.513873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:33.525432 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:33.566770 tst iperf3m4.py: using LAC 23741 21:09:33.696191 tst iperf3m4.py: using RAC 26 21:09:33.825352 tst iperf3m4.py: using CellId 23741 21:09:33.954169 tst iperf3m4.py: using BVCI 23742 21:09:34.072566 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.084236 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.095727 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.107041 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.118263 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.129477 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.140876 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.151994 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:34.164212 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:34.280140 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:34.403358 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:34.520763 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:34.643979 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:09:34.865009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:35.193457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Launched 21:09:35.476697 run iperf3-srv_10.42.42.10(pid=15553): Launched 21:09:35.598771 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:09:35.819119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:36.147182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15554): Launched 21:09:36.431143 run iperf3-srv_10.42.42.10(pid=15555): Launched 21:09:36.554819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:09:36.775254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:37.103611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15556): Launched 21:09:37.388206 run iperf3-srv_10.42.42.10(pid=15557): Launched 21:09:37.511468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:09:37.731903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:09:38.059809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15558): Launched 21:09:38.344315 run iperf3-srv_10.42.42.10(pid=15559): Launched 21:09:38.459824 tst iperf3m4.py:8: start network... 21:09:38.665895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:39.140853 run create_hlr_db(pid=15560): Launched 21:09:39.257384 bus /gobi_6: Setting Powered False 21:09:40.318641 run create_hlr_db(pid=15560): Terminated: ok {rc=0} 21:09:40.744370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Launched 21:09:41.049965 run osmo-hlr_10.42.42.2(pid=15563): Launched 21:09:41.166754 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:41.708246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Launched 21:09:42.014855 run osmo-stp_10.42.42.5(pid=15566): Launched 21:09:42.131158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:42.657713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Launched 21:09:42.775077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:43.034654 run patchelf(pid=15569): Launched 21:09:43.203140 run osmo-stp_10.42.42.5(pid=15566): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] 21:09:43.331793 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-09_21:09:41.958068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:43.462406 run osmo-stp_10.42.42.5(pid=15566): stderr: | 20221209210942125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210942125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210942126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210942126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210942126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210942127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210942127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:43.592627 run osmo-stp_10.42.42.5(pid=15566): stdout: | (launched: 2022-12-09_21:09:41.958068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:43.718108 run osmo-stp_10.42.42.5(pid=15566): stderr: | 20221209210942125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210942125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210942126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210942126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210942126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210942127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210942127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:43.866181 run patchelf(pid=15569): Terminating (SIGINT) 21:09:44.037310 run patchelf(pid=15569): Terminated: ok {rc=0} 21:09:44.161628 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 21:09:44.171280 tst iperf3m4.py:8: Test FAILED (10.7 sec) 21:09:44.199102 run osmo-hlr_10.42.42.2(pid=15563): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15563)] 21:09:44.246680 run osmo-hlr_10.42.42.2(pid=15563): stdout: | (launched: 2022-12-09_21:09:40.993145) 21:09:44.295667 run osmo-hlr_10.42.42.2(pid=15563): stderr: | 20221209210941170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210941170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210941170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210941170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210941170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210941170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210941182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210941190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210941190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210941191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:09:44.345326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Terminating (SIGTERM) 21:09:44.384392 run iperf3-srv_10.42.42.10(pid=15553): Terminating (SIGTERM) 21:09:44.423362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15554): Terminating (SIGTERM) 21:09:44.462520 run iperf3-srv_10.42.42.10(pid=15555): Terminating (SIGTERM) 21:09:44.501519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15556): Terminating (SIGTERM) 21:09:44.540660 run iperf3-srv_10.42.42.10(pid=15557): Terminating (SIGTERM) 21:09:44.579443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15558): Terminating (SIGTERM) 21:09:44.618439 run iperf3-srv_10.42.42.10(pid=15559): Terminating (SIGTERM) 21:09:44.656934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminating (SIGTERM) 21:09:44.696256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminating (SIGTERM) 21:09:44.735199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Terminating (SIGTERM) 21:09:44.774447 --- ParallelTerminationStrategy: PID 15552 died... 21:09:44.793413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Terminated: ok {rc=0} 21:09:44.837296 --- ParallelTerminationStrategy: PID 15553 died... 21:09:44.855684 run iperf3-srv_10.42.42.10(pid=15553): Terminated {rc=256} 21:09:44.899099 --- ParallelTerminationStrategy: PID 15554 died... 21:09:44.917572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15554): Terminated: ok {rc=0} 21:09:44.961098 --- ParallelTerminationStrategy: PID 15555 died... 21:09:44.979389 run iperf3-srv_10.42.42.10(pid=15555): Terminated {rc=256} 21:09:45.022764 --- ParallelTerminationStrategy: PID 15556 died... 21:09:45.040896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15556): Terminated: ok {rc=0} 21:09:45.084897 --- ParallelTerminationStrategy: PID 15557 died... 21:09:45.103848 run iperf3-srv_10.42.42.10(pid=15557): Terminated {rc=256} 21:09:45.147710 --- ParallelTerminationStrategy: PID 15558 died... 21:09:45.166202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15558): Terminated: ok {rc=0} 21:09:45.209738 --- ParallelTerminationStrategy: PID 15559 died... 21:09:45.228085 run iperf3-srv_10.42.42.10(pid=15559): Terminated {rc=256} 21:09:45.271471 --- ParallelTerminationStrategy: PID 15562 died... 21:09:45.289780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15562): Terminated: ok {rc=0} 21:09:45.333382 --- ParallelTerminationStrategy: PID 15565 died... 21:09:45.351756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15565): Terminated: ok {rc=0} 21:09:45.395637 --- ParallelTerminationStrategy: PID 15568 died... 21:09:45.414169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15568): Terminated: ok {rc=0} 21:09:45.499752 bus /gobi_4: Setting Powered False 21:09:46.602195 bus /gobi_4: Setting Powered False 21:09:47.721988 bus /gobi_1: Setting Powered False 21:09:48.820704 bus /gobi_1: Setting Powered False 21:09:49.932762 bus /gobi_0: Setting Powered False 21:09:51.030788 bus /gobi_0: Setting Powered False 21:09:52.146776 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 21:09:53.250844 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.263004 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:09:53.304725 tst ping.py: using LAC 23742 21:09:53.435028 tst ping.py: using RAC 27 21:09:53.560767 tst ping.py: using CellId 23742 21:09:53.684674 tst ping.py: using BVCI 23743 21:09:53.801633 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.812928 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.824351 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.835878 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.847012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.858200 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.869631 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:09:53.880854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:09:53.994962 tst ping.py:19: start network... 21:09:54.195590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:09:54.657162 run create_hlr_db(pid=15570): Launched 21:09:54.788423 bus /gobi_6: Setting Powered False 21:09:55.851121 run create_hlr_db(pid=15570): Terminated: ok {rc=0} 21:09:56.296576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Launched 21:09:56.617202 run osmo-hlr_10.42.42.2(pid=15573): Launched 21:09:56.738795 run osmo-stp_10.42.42.5: Starting osmo-stp 21:09:57.292069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Launched 21:09:57.611295 run osmo-stp_10.42.42.5(pid=15576): Launched 21:09:57.735150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:09:58.289754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Launched 21:09:58.413344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:09:58.684857 run patchelf(pid=15579): Launched 21:09:58.864430 run osmo-stp_10.42.42.5(pid=15576): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] 21:09:58.999730 run osmo-stp_10.42.42.5(pid=15576): stdout: | (launched: 2022-12-09_21:09:57.552261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:59.136409 run osmo-stp_10.42.42.5(pid=15576): stderr: | 20221209210957745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210957746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210957746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210957746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210957747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210957747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210957747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:59.273639 run osmo-stp_10.42.42.5(pid=15576): stdout: | (launched: 2022-12-09_21:09:57.552261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:09:59.404705 run osmo-stp_10.42.42.5(pid=15576): stderr: | 20221209210957745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209210957746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209210957746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209210957746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209210957747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209210957747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209210957747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:09:59.559351 run patchelf(pid=15579): Terminating (SIGINT) 21:09:59.737798 run patchelf(pid=15579): Terminated: ok {rc=0} 21:09:59.866789 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15576): Process ended prematurely: osmo-stp_10.42.42.5(pid=15576) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 21:09:59.876435 tst ping.py:22: Test FAILED (6.6 sec) 21:09:59.904745 run osmo-hlr_10.42.42.2(pid=15573): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15573)] 21:09:59.954522 run osmo-hlr_10.42.42.2(pid=15573): stdout: | (launched: 2022-12-09_21:09:56.557438) 21:10:00.006024 run osmo-hlr_10.42.42.2(pid=15573): stderr: | 20221209210956758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209210956758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209210956758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209210956759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209210956759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209210956759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209210956771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209210956779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209210956780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209210956780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:00.057881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Terminating (SIGTERM) 21:10:00.099184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Terminating (SIGTERM) 21:10:00.140496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Terminating (SIGTERM) 21:10:00.182535 --- ParallelTerminationStrategy: PID 15572 died... 21:10:00.202449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15572): Terminated: ok {rc=0} 21:10:00.248088 --- ParallelTerminationStrategy: PID 15575 died... 21:10:00.267427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15575): Terminated: ok {rc=0} 21:10:00.313603 --- ParallelTerminationStrategy: PID 15578 died... 21:10:00.333157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15578): Terminated: ok {rc=0} 21:10:00.419165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:10:01.510562 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:01.526291 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:10:01.580483 tst ping_idle_ping.py: using LAC 23743 21:10:01.708660 tst ping_idle_ping.py: using RAC 28 21:10:01.880419 tst ping_idle_ping.py: using CellId 23743 21:10:02.016733 tst ping_idle_ping.py: using BVCI 23744 21:10:02.136178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.148399 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.160486 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.172592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.184466 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.196381 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.208538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:10:02.220570 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:10:02.342421 tst ping_idle_ping.py:24: start network... 21:10:02.557852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:03.062979 run create_hlr_db(pid=15583): Launched 21:10:03.193477 bus /gobi_6: Setting Powered False 21:10:04.256703 run create_hlr_db(pid=15583): Terminated: ok {rc=0} 21:10:04.686385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15585): Launched 21:10:04.987496 run osmo-hlr_10.42.42.2(pid=15586): Launched 21:10:05.102760 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:05.663269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15588): Launched 21:10:05.985196 run osmo-stp_10.42.42.5(pid=15589): Launched 21:10:06.106913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:06.659661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15591): Launched 21:10:06.782831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:07.053573 run patchelf(pid=15592): Launched 21:10:07.232627 run osmo-stp_10.42.42.5(pid=15589): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15589)] 21:10:07.368151 run osmo-stp_10.42.42.5(pid=15589): stdout: | (launched: 2022-12-09_21:10:05.926377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:07.506348 run osmo-stp_10.42.42.5(pid=15589): stderr: | 20221209211006120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211006120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211006121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211006121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211006122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211006122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211006122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:07.643738 run osmo-stp_10.42.42.5(pid=15589): stdout: | (launched: 2022-12-09_21:10:05.926377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:07.775488 run osmo-stp_10.42.42.5(pid=15589): stderr: | 20221209211006120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211006120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211006121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211006121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211006122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211006122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211006122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:07.931833 run patchelf(pid=15592): Terminating (SIGINT) 21:10:08.111669 run patchelf(pid=15592): Terminated: ok {rc=0} 21:10:08.241973 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15589): Process ended prematurely: osmo-stp_10.42.42.5(pid=15589) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15589)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:10:08.251537 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 21:10:08.279620 run osmo-hlr_10.42.42.2(pid=15586): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15586)] 21:10:08.329134 run osmo-hlr_10.42.42.2(pid=15586): stdout: | (launched: 2022-12-09_21:10:04.931491) 21:10:08.380292 run osmo-hlr_10.42.42.2(pid=15586): stderr: | 20221209211005108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211005108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211005108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211005108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211005108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211005108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211005119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211005128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211005128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211005128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:08.431845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15585): Terminating (SIGTERM) 21:10:08.473065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15588): Terminating (SIGTERM) 21:10:08.514397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15591): Terminating (SIGTERM) 21:10:08.555953 --- ParallelTerminationStrategy: PID 15585 died... 21:10:08.575797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15585): Terminated: ok {rc=0} 21:10:08.621593 --- ParallelTerminationStrategy: PID 15588 died... 21:10:08.640913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15588): Terminated: ok {rc=0} 21:10:08.686315 --- ParallelTerminationStrategy: PID 15591 died... 21:10:08.705625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15591): Terminated: ok {rc=0} 21:10:08.791677 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:10:10.091439 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:10:10.098844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:10:10.123226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:10:10.162454 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:10:10.250950 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:10:10.274785 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:10:10.314512 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:10:10.912662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:10:10.965542 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:10.976598 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:11.037673 tst cs_paging_gprs_active.py: using LAC 23744 21:10:11.165896 tst cs_paging_gprs_active.py: using RAC 29 21:10:11.291910 tst cs_paging_gprs_active.py: using CellId 23744 21:10:11.417839 tst cs_paging_gprs_active.py: using BVCI 23745 21:10:11.535892 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.547327 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.558699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.570059 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.581387 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.592631 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.603961 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.615119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:11.626554 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:11.747962 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:11.864940 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:10:12.072278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:12.380492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15596): Launched 21:10:12.647325 run iperf3-srv_10.42.42.10(pid=15597): Launched 21:10:12.763361 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:10:12.969043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:13.276584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Launched 21:10:13.542367 run iperf3-srv_10.42.42.10(pid=15599): Launched 21:10:13.658459 tst cs_paging_gprs_active.py:38: start network... 21:10:13.863835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:14.338107 run create_hlr_db(pid=15600): Launched 21:10:14.455850 bus /gobi_6: Setting Powered False 21:10:15.516035 run create_hlr_db(pid=15600): Terminated: ok {rc=0} 21:10:15.981977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15602): Launched 21:10:16.334402 run osmo-hlr_10.42.42.2(pid=15603): Launched 21:10:16.514636 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:17.220847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15605): Launched 21:10:17.532345 run osmo-stp_10.42.42.5(pid=15606): Launched 21:10:17.649125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:18.176416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15608): Launched 21:10:18.292752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:18.550611 run patchelf(pid=15609): Launched 21:10:18.719963 run osmo-stp_10.42.42.5(pid=15606): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15606)] 21:10:18.848763 run osmo-stp_10.42.42.5(pid=15606): stdout: | (launched: 2022-12-09_21:10:17.475377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:18.979055 run osmo-stp_10.42.42.5(pid=15606): stderr: | 20221209211017646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211017646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211017646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211017646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211017647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211017647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211017647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:19.109299 run osmo-stp_10.42.42.5(pid=15606): stdout: | (launched: 2022-12-09_21:10:17.475377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:19.233843 run osmo-stp_10.42.42.5(pid=15606): stderr: | 20221209211017646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211017646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211017646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211017646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211017647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211017647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211017647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:19.381548 run patchelf(pid=15609): Terminating (SIGINT) 21:10:19.552284 run patchelf(pid=15609): Terminated: ok {rc=0} 21:10:19.675284 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15606): Process ended prematurely: osmo-stp_10.42.42.5(pid=15606) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15606)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:10:19.684877 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:10:19.712310 run osmo-hlr_10.42.42.2(pid=15603): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15603)] 21:10:19.760052 run osmo-hlr_10.42.42.2(pid=15603): stdout: | (launched: 2022-12-09_21:10:16.268609) 21:10:19.809112 run osmo-hlr_10.42.42.2(pid=15603): stderr: | 20221209211016568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211016568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211016568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211016568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211016568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211016569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211016584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211016596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211016601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211016601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:19.858840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15596): Terminating (SIGTERM) 21:10:19.898417 run iperf3-srv_10.42.42.10(pid=15597): Terminating (SIGTERM) 21:10:19.937867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Terminating (SIGTERM) 21:10:19.977578 run iperf3-srv_10.42.42.10(pid=15599): Terminating (SIGTERM) 21:10:20.017354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15602): Terminating (SIGTERM) 21:10:20.057364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15605): Terminating (SIGTERM) 21:10:20.096926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15608): Terminating (SIGTERM) 21:10:20.136827 --- ParallelTerminationStrategy: PID 15596 died... 21:10:20.155889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15596): Terminated: ok {rc=0} 21:10:20.200182 --- ParallelTerminationStrategy: PID 15597 died... 21:10:20.218607 run iperf3-srv_10.42.42.10(pid=15597): Terminated {rc=256} 21:10:20.262298 --- ParallelTerminationStrategy: PID 15598 died... 21:10:20.280555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Terminated: ok {rc=0} 21:10:20.323939 --- ParallelTerminationStrategy: PID 15599 died... 21:10:20.342270 run iperf3-srv_10.42.42.10(pid=15599): Terminated {rc=256} 21:10:20.385810 --- ParallelTerminationStrategy: PID 15602 died... 21:10:20.404193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15602): Terminated: ok {rc=0} 21:10:20.447877 --- ParallelTerminationStrategy: PID 15605 died... 21:10:20.466396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15605): Terminated: ok {rc=0} 21:10:20.510065 --- ParallelTerminationStrategy: PID 15608 died... 21:10:20.528384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15608): Terminated: ok {rc=0} 21:10:20.611406 bus /gobi_0: Setting Powered False 21:10:21.709806 bus /gobi_0: Setting Powered False 21:10:22.824272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:10:23.973291 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:23.985381 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:24.049434 tst iperf3.py: using LAC 23745 21:10:24.176523 tst iperf3.py: using RAC 30 21:10:24.302763 tst iperf3.py: using CellId 23745 21:10:24.431047 tst iperf3.py: using BVCI 23746 21:10:24.548530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.560207 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.571431 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.582769 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.594073 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.605374 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.616690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.627934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:24.639290 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:24.756225 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:24.960876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:25.267946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15611): Launched 21:10:25.534059 run iperf3-srv_10.42.42.10(pid=15612): Launched 21:10:25.647671 tst iperf3.py:8: start network... 21:10:25.851744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:26.323718 run create_hlr_db(pid=15613): Launched 21:10:26.440287 bus /gobi_6: Setting Powered False 21:10:27.501240 run create_hlr_db(pid=15613): Terminated: ok {rc=0} 21:10:27.945559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15615): Launched 21:10:28.271962 run osmo-hlr_10.42.42.2(pid=15616): Launched 21:10:28.397156 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:28.963657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15618): Launched 21:10:29.289691 run osmo-stp_10.42.42.5(pid=15619): Launched 21:10:29.413634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:29.974949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15621): Launched 21:10:30.099494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:30.375026 run patchelf(pid=15622): Launched 21:10:30.555914 run osmo-stp_10.42.42.5(pid=15619): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15619)] 21:10:30.693157 run osmo-stp_10.42.42.5(pid=15619): stdout: | (launched: 2022-12-09_21:10:29.229877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:30.832251 run osmo-stp_10.42.42.5(pid=15619): stderr: | 20221209211029424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211029424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211029425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211029425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211029426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211029426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211029426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:30.982324 run osmo-stp_10.42.42.5(pid=15619): stdout: | (launched: 2022-12-09_21:10:29.229877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:31.117684 run osmo-stp_10.42.42.5(pid=15619): stderr: | 20221209211029424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211029424 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211029425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211029425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211029426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211029426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211029426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:31.280148 run patchelf(pid=15622): Terminating (SIGINT) 21:10:31.494617 run patchelf(pid=15622): Terminated: ok {rc=0} 21:10:31.630725 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15619): Process ended prematurely: osmo-stp_10.42.42.5(pid=15619) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15619)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:10:31.641696 tst iperf3.py:8: Test FAILED (7.7 sec) 21:10:31.671004 run osmo-hlr_10.42.42.2(pid=15616): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15616)] 21:10:31.721415 run osmo-hlr_10.42.42.2(pid=15616): stdout: | (launched: 2022-12-09_21:10:28.212413) 21:10:31.773408 run osmo-hlr_10.42.42.2(pid=15616): stderr: | 20221209211028410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211028410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211028410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211028410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211028410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211028410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211028423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211028433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211028433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211028433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:31.827746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15611): Terminating (SIGTERM) 21:10:31.870433 run iperf3-srv_10.42.42.10(pid=15612): Terminating (SIGTERM) 21:10:31.915676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15615): Terminating (SIGTERM) 21:10:31.958576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15618): Terminating (SIGTERM) 21:10:32.002457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15621): Terminating (SIGTERM) 21:10:32.044872 --- ParallelTerminationStrategy: PID 15611 died... 21:10:32.065351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15611): Terminated: ok {rc=0} 21:10:32.113202 --- ParallelTerminationStrategy: PID 15612 died... 21:10:32.133533 run iperf3-srv_10.42.42.10(pid=15612): Terminated {rc=256} 21:10:32.181406 --- ParallelTerminationStrategy: PID 15615 died... 21:10:32.201530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15615): Terminated: ok {rc=0} 21:10:32.248198 --- ParallelTerminationStrategy: PID 15618 died... 21:10:32.268338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15618): Terminated: ok {rc=0} 21:10:32.314656 --- ParallelTerminationStrategy: PID 15621 died... 21:10:32.334161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15621): Terminated: ok {rc=0} 21:10:32.420859 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:10:33.566691 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:33.578533 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:33.638725 tst iperf3m4.py: using LAC 23746 21:10:33.764834 tst iperf3m4.py: using RAC 31 21:10:33.884835 tst iperf3m4.py: using CellId 23746 21:10:34.003089 tst iperf3m4.py: using BVCI 23747 21:10:34.114824 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.125924 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.136898 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.148034 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.159139 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.170628 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.181971 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.193095 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:34.204426 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:34.319871 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:34.443223 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:34.559033 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:34.679556 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:10:34.899276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:35.225815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15623): Launched 21:10:35.509798 run iperf3-srv_10.42.42.10(pid=15624): Launched 21:10:35.632436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:10:35.850329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:36.176357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15625): Launched 21:10:36.460298 run iperf3-srv_10.42.42.10(pid=15626): Launched 21:10:36.581892 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:10:36.799954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:37.125784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15627): Launched 21:10:37.410514 run iperf3-srv_10.42.42.10(pid=15628): Launched 21:10:37.531742 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:10:37.749870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:10:38.075258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15629): Launched 21:10:38.359980 run iperf3-srv_10.42.42.10(pid=15630): Launched 21:10:38.481427 tst iperf3m4.py:8: start network... 21:10:38.700345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:39.206554 run create_hlr_db(pid=15631): Launched 21:10:39.338388 bus /gobi_6: Setting Powered False 21:10:40.402714 run create_hlr_db(pid=15631): Terminated: ok {rc=0} 21:10:40.855528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Launched 21:10:41.180821 run osmo-hlr_10.42.42.2(pid=15634): Launched 21:10:41.307340 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:41.866439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Launched 21:10:42.220148 run osmo-stp_10.42.42.5(pid=15637): Launched 21:10:42.343808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:42.904584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Launched 21:10:43.027920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:43.303077 run patchelf(pid=15640): Launched 21:10:43.484235 run osmo-stp_10.42.42.5(pid=15637): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] 21:10:43.621118 run osmo-stp_10.42.42.5(pid=15637): stdout: | (launched: 2022-12-09_21:10:42.159223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:43.759707 run osmo-stp_10.42.42.5(pid=15637): stderr: | 20221209211042351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211042351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211042352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211042352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211042352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211042353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211042353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:43.898512 run osmo-stp_10.42.42.5(pid=15637): stdout: | (launched: 2022-12-09_21:10:42.159223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:44.031443 run osmo-stp_10.42.42.5(pid=15637): stderr: | 20221209211042351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211042351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211042352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211042352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211042352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211042353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211042353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:44.189695 run patchelf(pid=15640): Terminating (SIGINT) 21:10:44.371800 run patchelf(pid=15640): Terminated: ok {rc=0} 21:10:44.502899 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15637): Process ended prematurely: osmo-stp_10.42.42.5(pid=15637) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:10:44.513316 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:10:44.542218 run osmo-hlr_10.42.42.2(pid=15634): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15634)] 21:10:44.591658 run osmo-hlr_10.42.42.2(pid=15634): stdout: | (launched: 2022-12-09_21:10:41.120714) 21:10:44.642876 run osmo-hlr_10.42.42.2(pid=15634): stderr: | 20221209211041320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211041320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211041320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211041320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211041320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211041320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211041333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211041341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211041341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211041342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:10:44.694395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15623): Terminating (SIGTERM) 21:10:44.735454 run iperf3-srv_10.42.42.10(pid=15624): Terminating (SIGTERM) 21:10:44.776541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15625): Terminating (SIGTERM) 21:10:44.817844 run iperf3-srv_10.42.42.10(pid=15626): Terminating (SIGTERM) 21:10:44.859082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15627): Terminating (SIGTERM) 21:10:44.900311 run iperf3-srv_10.42.42.10(pid=15628): Terminating (SIGTERM) 21:10:44.941545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15629): Terminating (SIGTERM) 21:10:44.982811 run iperf3-srv_10.42.42.10(pid=15630): Terminating (SIGTERM) 21:10:45.023889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Terminating (SIGTERM) 21:10:45.065600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Terminating (SIGTERM) 21:10:45.107031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Terminating (SIGTERM) 21:10:45.148561 --- ParallelTerminationStrategy: PID 15623 died... 21:10:45.168412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15623): Terminated: ok {rc=0} 21:10:45.214320 --- ParallelTerminationStrategy: PID 15624 died... 21:10:45.233647 run iperf3-srv_10.42.42.10(pid=15624): Terminated {rc=256} 21:10:45.279299 --- ParallelTerminationStrategy: PID 15625 died... 21:10:45.298670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15625): Terminated: ok {rc=0} 21:10:45.344519 --- ParallelTerminationStrategy: PID 15626 died... 21:10:45.363899 run iperf3-srv_10.42.42.10(pid=15626): Terminated {rc=256} 21:10:45.409165 --- ParallelTerminationStrategy: PID 15627 died... 21:10:45.428362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15627): Terminated: ok {rc=0} 21:10:45.474329 --- ParallelTerminationStrategy: PID 15628 died... 21:10:45.493641 run iperf3-srv_10.42.42.10(pid=15628): Terminated {rc=256} 21:10:45.538914 --- ParallelTerminationStrategy: PID 15629 died... 21:10:45.558394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15629): Terminated: ok {rc=0} 21:10:45.604152 --- ParallelTerminationStrategy: PID 15630 died... 21:10:45.623452 run iperf3-srv_10.42.42.10(pid=15630): Terminated {rc=256} 21:10:45.668677 --- ParallelTerminationStrategy: PID 15633 died... 21:10:45.688023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15633): Terminated: ok {rc=0} 21:10:45.733371 --- ParallelTerminationStrategy: PID 15636 died... 21:10:45.752762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15636): Terminated: ok {rc=0} 21:10:45.798109 --- ParallelTerminationStrategy: PID 15639 died... 21:10:45.817637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15639): Terminated: ok {rc=0} 21:10:45.915686 bus /gobi_4: Setting Powered False 21:10:47.020205 bus /gobi_4: Setting Powered False 21:10:48.147652 bus /gobi_1: Setting Powered False 21:10:49.246539 bus /gobi_1: Setting Powered False 21:10:50.361718 bus /gobi_0: Setting Powered False 21:10:51.457825 bus /gobi_0: Setting Powered False 21:10:52.571990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:10:53.674063 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:53.686128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:10:53.747770 tst ping.py: using LAC 23747 21:10:53.871608 tst ping.py: using RAC 32 21:10:53.997046 tst ping.py: using CellId 23747 21:10:54.120220 tst ping.py: using BVCI 23748 21:10:54.234533 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.246163 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.257659 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.268925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.280261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.291573 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.302858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:10:54.314125 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:10:54.428312 tst ping.py:19: start network... 21:10:54.639930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:10:55.127528 run create_hlr_db(pid=15641): Launched 21:10:55.255702 bus /gobi_6: Setting Powered False 21:10:56.318070 run create_hlr_db(pid=15641): Terminated: ok {rc=0} 21:10:56.740580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15643): Launched 21:10:57.035630 run osmo-hlr_10.42.42.2(pid=15644): Launched 21:10:57.147031 run osmo-stp_10.42.42.5: Starting osmo-stp 21:10:57.673740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15646): Launched 21:10:57.967117 run osmo-stp_10.42.42.5(pid=15647): Launched 21:10:58.078820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:10:58.586107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15649): Launched 21:10:58.697751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:10:58.945094 run patchelf(pid=15650): Launched 21:10:59.107814 run osmo-stp_10.42.42.5(pid=15647): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15647)] 21:10:59.231661 run osmo-stp_10.42.42.5(pid=15647): stdout: | (launched: 2022-12-09_21:10:57.912523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:59.357414 run osmo-stp_10.42.42.5(pid=15647): stderr: | 20221209211058080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211058080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211058080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211058081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211058081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211058081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211058081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:59.482847 run osmo-stp_10.42.42.5(pid=15647): stdout: | (launched: 2022-12-09_21:10:57.912523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:10:59.602629 run osmo-stp_10.42.42.5(pid=15647): stderr: | 20221209211058080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211058080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211058080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211058081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211058081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211058081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211058081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:10:59.745257 run patchelf(pid=15650): Terminating (SIGINT) 21:10:59.919588 run patchelf(pid=15650): Terminated: ok {rc=0} 21:11:00.036716 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15647): Process ended prematurely: osmo-stp_10.42.42.5(pid=15647) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15647)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 21:11:00.045767 tst ping.py:22: Test FAILED (6.4 sec) 21:11:00.072375 run osmo-hlr_10.42.42.2(pid=15644): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15644)] 21:11:00.118891 run osmo-hlr_10.42.42.2(pid=15644): stdout: | (launched: 2022-12-09_21:10:56.980783) 21:11:00.167311 run osmo-hlr_10.42.42.2(pid=15644): stderr: | 20221209211057157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211057157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211057157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211057157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211057157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211057157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211057170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211057178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211057178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211057178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:00.215969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15643): Terminating (SIGTERM) 21:11:00.254624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15646): Terminating (SIGTERM) 21:11:00.293859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15649): Terminating (SIGTERM) 21:11:00.333139 --- ParallelTerminationStrategy: PID 15643 died... 21:11:00.351812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15643): Terminated: ok {rc=0} 21:11:00.395125 --- ParallelTerminationStrategy: PID 15646 died... 21:11:00.413215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15646): Terminated: ok {rc=0} 21:11:00.456358 --- ParallelTerminationStrategy: PID 15649 died... 21:11:00.474560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15649): Terminated: ok {rc=0} 21:11:00.556436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:11:01.642028 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:01.654780 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:11:01.717810 tst ping_idle_ping.py: using LAC 23748 21:11:01.869285 tst ping_idle_ping.py: using RAC 33 21:11:01.993108 tst ping_idle_ping.py: using CellId 23748 21:11:02.145537 tst ping_idle_ping.py: using BVCI 23749 21:11:02.269678 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.281612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.293290 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.306194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.317274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.328141 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.339173 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:11:02.350234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:11:02.468109 tst ping_idle_ping.py:24: start network... 21:11:02.677210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:03.160688 run create_hlr_db(pid=15651): Launched 21:11:03.287811 bus /gobi_6: Setting Powered False 21:11:04.350901 run create_hlr_db(pid=15651): Terminated: ok {rc=0} 21:11:04.766335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15653): Launched 21:11:05.055601 run osmo-hlr_10.42.42.2(pid=15654): Launched 21:11:05.165932 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:05.678244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15656): Launched 21:11:05.968393 run osmo-stp_10.42.42.5(pid=15657): Launched 21:11:06.078833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:06.580010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15659): Launched 21:11:06.690675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:06.935407 run patchelf(pid=15660): Launched 21:11:07.095919 run osmo-stp_10.42.42.5(pid=15657): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15657)] 21:11:07.218546 run osmo-stp_10.42.42.5(pid=15657): stdout: | (launched: 2022-12-09_21:11:05.914181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:07.343681 run osmo-stp_10.42.42.5(pid=15657): stderr: | 20221209211106080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211106080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211106080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211106081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211106081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211106081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211106081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:07.468443 run osmo-stp_10.42.42.5(pid=15657): stdout: | (launched: 2022-12-09_21:11:05.914181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:07.587341 run osmo-stp_10.42.42.5(pid=15657): stderr: | 20221209211106080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211106080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211106080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211106081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211106081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211106081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211106081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:07.728559 run patchelf(pid=15660): Terminating (SIGINT) 21:11:07.892189 run patchelf(pid=15660): Terminated: ok {rc=0} 21:11:08.010060 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15657): Process ended prematurely: osmo-stp_10.42.42.5(pid=15657) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15657)] [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:11:08.018770 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 21:11:08.045314 run osmo-hlr_10.42.42.2(pid=15654): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15654)] 21:11:08.092207 run osmo-hlr_10.42.42.2(pid=15654): stdout: | (launched: 2022-12-09_21:11:05.002439) 21:11:08.140335 run osmo-hlr_10.42.42.2(pid=15654): stderr: | 20221209211105173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211105173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211105173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211105173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211105173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211105173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211105186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211105194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211105195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211105195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:08.188814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15653): Terminating (SIGTERM) 21:11:08.227998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15656): Terminating (SIGTERM) 21:11:08.267081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15659): Terminating (SIGTERM) 21:11:08.306297 --- ParallelTerminationStrategy: PID 15653 died... 21:11:08.324831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15653): Terminated: ok {rc=0} 21:11:08.368342 --- ParallelTerminationStrategy: PID 15656 died... 21:11:08.386506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15656): Terminated: ok {rc=0} 21:11:08.429718 --- ParallelTerminationStrategy: PID 15659 died... 21:11:08.447888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15659): Terminated: ok {rc=0} 21:11:08.532582 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:11:09.823500 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:09.831135 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:11:09.855442 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:11:09.889577 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:11:09.942730 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:11:09.966198 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:11:09.999860 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:11:10.558960 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:11:10.563965 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:10.575344 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:11:10.634025 tst switch_tch_pdch.py: using LAC 23749 21:11:10.749234 tst switch_tch_pdch.py: using RAC 34 21:11:10.872267 tst switch_tch_pdch.py: using CellId 23749 21:11:10.993956 tst switch_tch_pdch.py: using BVCI 23750 21:11:11.108470 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.120698 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.132737 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.144496 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.156384 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.168211 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.180129 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:11:11.191982 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:11:11.306887 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:11:11.424250 tst switch_tch_pdch.py:51: start network... 21:11:11.632753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:12.113462 run create_hlr_db(pid=15665): Launched 21:11:12.239059 bus /gobi_6: Setting Powered False 21:11:13.300791 run create_hlr_db(pid=15665): Terminated: ok {rc=0} 21:11:13.716308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15667): Launched 21:11:14.005975 run osmo-hlr_10.42.42.2(pid=15668): Launched 21:11:14.115831 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:14.653217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15670): Launched 21:11:14.963753 run osmo-stp_10.42.42.5(pid=15671): Launched 21:11:15.080669 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:11:15.616305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15673): Launched 21:11:15.734976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:11:16.033767 run patchelf(pid=15674): Launched 21:11:16.213518 run osmo-stp_10.42.42.5(pid=15671): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15671)] 21:11:16.348699 run osmo-stp_10.42.42.5(pid=15671): stdout: | (launched: 2022-12-09_21:11:14.906747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:16.485675 run osmo-stp_10.42.42.5(pid=15671): stderr: | 20221209211115096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211115096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211115096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211115096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211115097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211115097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211115097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:16.621588 run osmo-stp_10.42.42.5(pid=15671): stdout: | (launched: 2022-12-09_21:11:14.906747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:16.751673 run osmo-stp_10.42.42.5(pid=15671): stderr: | 20221209211115096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211115096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211115096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211115096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211115097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211115097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211115097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:16.905843 run patchelf(pid=15674): Terminating (SIGINT) 21:11:17.082890 run patchelf(pid=15674): Terminated: ok {rc=0} 21:11:17.210090 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15671): Process ended prematurely: osmo-stp_10.42.42.5(pid=15671) [trial-2364↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15671)] [trial-2364↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:11:17.219932 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 21:11:17.247934 run osmo-hlr_10.42.42.2(pid=15668): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15668)] 21:11:17.297483 run osmo-hlr_10.42.42.2(pid=15668): stdout: | (launched: 2022-12-09_21:11:13.952397) 21:11:17.348268 run osmo-hlr_10.42.42.2(pid=15668): stderr: | 20221209211114122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211114122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211114123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211114123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211114123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211114123 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211114135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211114144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211114144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211114144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:17.399483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15667): Terminating (SIGTERM) 21:11:17.440563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15670): Terminating (SIGTERM) 21:11:17.481761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15673): Terminating (SIGTERM) 21:11:17.523144 --- ParallelTerminationStrategy: PID 15667 died... 21:11:17.542838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15667): Terminated: ok {rc=0} 21:11:17.588102 --- ParallelTerminationStrategy: PID 15670 died... 21:11:17.607192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15670): Terminated: ok {rc=0} 21:11:17.652444 --- ParallelTerminationStrategy: PID 15673 died... 21:11:17.671563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15673): Terminated: ok {rc=0} 21:11:17.757776 bus /gobi_0: Setting Powered False 21:11:18.854706 bus /gobi_0: Setting Powered False 21:11:19.971485 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 sms:nanobts+band-900 --------------------------------------------------------------------- 21:11:21.215019 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:21.220181 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:21.253160 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:11:21.280136 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 21:11:21.331337 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:21.363010 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:11:21.388724 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 21:11:21.935817 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 21:11:21.940773 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:21.951380 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:21.995971 tst mo_mt_sms.py: using LAC 23750 21:11:22.113769 tst mo_mt_sms.py: using RAC 35 21:11:22.236381 tst mo_mt_sms.py: using CellId 23750 21:11:22.357019 tst mo_mt_sms.py: using BVCI 23751 21:11:22.469202 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:22.480391 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:22.491591 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:22.502663 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:22.513883 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:22.524557 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:11:22.636105 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 21:11:22.747939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:23.196013 run create_hlr_db(pid=15678): Launched 21:11:23.307463 bus /gobi_6: Setting Powered False 21:11:24.365620 run create_hlr_db(pid=15678): Terminated: ok {rc=0} 21:11:24.791514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Launched 21:11:25.101806 run osmo-hlr_10.42.42.2(pid=15681): Launched 21:11:25.219743 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:25.751331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Launched 21:11:26.060541 run osmo-stp_10.42.42.5(pid=15684): Launched 21:11:26.177840 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:26.738347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15686): Launched 21:11:27.047224 run osmo-msc_10.42.42.6(pid=15687): Launched 21:11:27.219628 run osmo-stp_10.42.42.5(pid=15684): ERR: Terminated: ERROR {rc=1} [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] 21:11:27.350361 run osmo-stp_10.42.42.5(pid=15684): stdout: | (launched: 2022-12-09_21:11:26.003717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:27.481249 run osmo-stp_10.42.42.5(pid=15684): stderr: | 20221209211126191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211126191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211126191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211126191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211126192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211126192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211126192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:27.611391 run osmo-stp_10.42.42.5(pid=15684): stdout: | (launched: 2022-12-09_21:11:26.003717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:27.735018 run osmo-stp_10.42.42.5(pid=15684): stderr: | 20221209211126191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211126191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211126191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211126191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211126192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211126192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211126192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:27.882720 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15684): Process ended prematurely: osmo-stp_10.42.42.5(pid=15684) [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py:16] 21:11:27.891704 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 21:11:27.918610 run osmo-hlr_10.42.42.2(pid=15681): ERR: Terminated: ERROR {rc=237} [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15681)] 21:11:27.967338 run osmo-hlr_10.42.42.2(pid=15681): stdout: | (launched: 2022-12-09_21:11:25.044655) 21:11:28.017890 run osmo-hlr_10.42.42.2(pid=15681): stderr: | 20221209211125238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211125238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211125238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211125238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211125238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211125238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211125251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211125259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211125260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211125260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:28.088292 run osmo-msc_10.42.42.6(pid=15687): ERR: Terminated: ERROR {rc=2} [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15687)] 21:11:28.136919 run osmo-msc_10.42.42.6(pid=15687): stdout: | (launched: 2022-12-09_21:11:26.990573) 21:11:28.187162 run osmo-msc_10.42.42.6(pid=15687): stderr: | 20221209211127307 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211127308 DLGLOBAL DEBUG validating counter group 0x7fa5b69bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211127308 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211127308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211127308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211127308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211127310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211127311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211127311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211127311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:28.238206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Terminating (SIGTERM) 21:11:28.278960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Terminating (SIGTERM) 21:11:28.319715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15686): Terminating (SIGTERM) 21:11:28.361065 --- ParallelTerminationStrategy: PID 15680 died... 21:11:28.380788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15680): Terminated: ok {rc=0} 21:11:28.426161 --- ParallelTerminationStrategy: PID 15683 died... 21:11:28.445444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15683): Terminated: ok {rc=0} 21:11:28.490447 --- ParallelTerminationStrategy: PID 15686 died... 21:11:28.509701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15686): Terminated: ok {rc=0} 21:11:28.595842 bus /sierra_3: Setting Powered False 21:11:29.689845 bus /sierra_3: Setting Powered False 21:11:30.803341 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 21:11:32.031085 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:32.037987 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:32.082829 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 21:11:32.092169 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:11:32.136397 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:32.169124 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 21:11:32.176835 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:11:32.692559 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:11:32.698347 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 21:11:32.709440 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:32.757034 tst assert_extension.py: using LAC 23751 21:11:32.875522 tst assert_extension.py: using RAC 36 21:11:33.000797 tst assert_extension.py: using CellId 23751 21:11:33.122183 tst assert_extension.py: using BVCI 23752 21:11:33.234563 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:11:33.350681 tst assert_extension.py:10: start nitb and bts... 21:11:33.558887 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:11:34.188910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15692): Launched 21:11:34.497282 run osmo-nitb_10.42.42.2(pid=15693): Launched 21:11:34.668565 run osmo-nitb_10.42.42.2(pid=15693): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15693)] 21:11:34.806904 run osmo-nitb_10.42.42.2(pid=15693): stdout: | (launched: 2022-12-09_21:11:34.440922) 21:11:34.946881 run osmo-nitb_10.42.42.2(pid=15693): stderr: | (launched: 2022-12-09_21:11:34.487178) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:11:35.086783 run osmo-nitb_10.42.42.2(pid=15693): stdout: | (launched: 2022-12-09_21:11:34.440922) 21:11:35.221833 run osmo-nitb_10.42.42.2(pid=15693): stderr: | (launched: 2022-12-09_21:11:34.487178) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15693) [trial-2364↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15693)] 21:11:35.614248 tst osmo-nitb_10.42.42.2(pid=15693): stdout: | (launched: 2022-12-09_21:11:34.440922) 21:11:35.739578 tst osmo-nitb_10.42.42.2(pid=15693): stderr: | (launched: 2022-12-09_21:11:34.487178) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:11:35.887229 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15693) [trial-2364↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15693)] [trial-2364↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 21:11:35.896126 tst assert_extension.py:12: Test FAILED (3.2 sec) 21:11:35.902966 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15692): Terminating (SIGTERM) 21:11:36.112519 --- ParallelTerminationStrategy: PID 15692 died... 21:11:36.133671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15692): Terminated: ok {rc=0} 21:11:36.218366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 ussd:nanobts+band-900 --------------------------------------------------------------------- 21:11:37.386136 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:37.392425 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:11:37.424943 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:11:37.451898 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 21:11:37.486788 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:11:37.518833 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:11:37.545424 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 21:11:38.075327 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 21:11:38.081402 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.091854 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 21:11:38.136378 tst assert_extension.py: using LAC 23752 21:11:38.253378 tst assert_extension.py: using RAC 37 21:11:38.366716 tst assert_extension.py: using CellId 23752 21:11:38.481545 tst assert_extension.py: using BVCI 23753 21:11:38.586541 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.597017 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.607521 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.618070 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.628642 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:11:38.639217 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 21:11:38.754737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:39.233293 run create_hlr_db(pid=15697): Launched 21:11:39.358845 bus /sierra_2: Setting Powered False 21:11:40.420400 run create_hlr_db(pid=15697): Terminated: ok {rc=0} 21:11:40.834445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15699): Launched 21:11:41.122868 run osmo-hlr_10.42.42.2(pid=15700): Launched 21:11:41.231865 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:41.736517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15702): Launched 21:11:42.025635 run osmo-stp_10.42.42.5(pid=15703): Launched 21:11:42.135967 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:42.658990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15705): Launched 21:11:42.946970 run osmo-msc_10.42.42.6(pid=15706): Launched 21:11:43.108167 run osmo-stp_10.42.42.5(pid=15703): ERR: Terminated: ERROR {rc=1} [trial-2364↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15703)] 21:11:43.231096 run osmo-stp_10.42.42.5(pid=15703): stdout: | (launched: 2022-12-09_21:11:41.972513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:43.353867 run osmo-stp_10.42.42.5(pid=15703): stderr: | 20221209211142137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211142138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211142138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211142138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211142139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211142139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211142139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:43.474484 run osmo-stp_10.42.42.5(pid=15703): stdout: | (launched: 2022-12-09_21:11:41.972513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:43.589886 run osmo-stp_10.42.42.5(pid=15703): stderr: | 20221209211142137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211142138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211142138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211142138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211142139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211142139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211142139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:43.727690 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15703): Process ended prematurely: osmo-stp_10.42.42.5(pid=15703) [trial-2364↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15703)] [trial-2364↪ussd:nanobts+band-900↪assert_extension.py:17] 21:11:43.735950 tst assert_extension.py:17: Test FAILED (5.6 sec) 21:11:43.761756 run osmo-hlr_10.42.42.2(pid=15700): ERR: Terminated: ERROR {rc=237} [trial-2364↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15700)] 21:11:43.808444 run osmo-hlr_10.42.42.2(pid=15700): stdout: | (launched: 2022-12-09_21:11:41.070120) 21:11:43.856637 run osmo-hlr_10.42.42.2(pid=15700): stderr: | 20221209211141238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211141238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211141238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211141238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211141238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211141238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211141250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211141259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211141260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211141260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:43.923989 run osmo-msc_10.42.42.6(pid=15706): ERR: Terminated: ERROR {rc=2} [trial-2364↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15706)] 21:11:43.970530 run osmo-msc_10.42.42.6(pid=15706): stdout: | (launched: 2022-12-09_21:11:42.894231) 21:11:44.018668 run osmo-msc_10.42.42.6(pid=15706): stderr: | 20221209211143161 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211143161 DLGLOBAL DEBUG validating counter group 0x7f2862761c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211143161 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211143161 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211143161 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211143161 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211143163 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211143163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211143164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211143164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:44.067078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15699): Terminating (SIGTERM) 21:11:44.105746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15702): Terminating (SIGTERM) 21:11:44.144209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15705): Terminating (SIGTERM) 21:11:44.183038 --- ParallelTerminationStrategy: PID 15699 died... 21:11:44.201627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15699): Terminated: ok {rc=0} 21:11:44.244585 --- ParallelTerminationStrategy: PID 15702 died... 21:11:44.262810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15702): Terminated: ok {rc=0} 21:11:44.305501 --- ParallelTerminationStrategy: PID 15705 died... 21:11:44.323476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15705): Terminated: ok {rc=0} 21:11:44.404407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 21:11:45.614369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:11:45.622475 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 21:11:45.655497 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 21:11:45.682264 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 21:11:45.733826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 21:11:45.766058 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 21:11:45.792692 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 21:11:46.342902 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 21:11:46.396140 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:46.408314 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:11:46.478716 tst mo_mt_call.py: using LAC 23753 21:11:46.636674 tst mo_mt_call.py: using RAC 38 21:11:46.756818 tst mo_mt_call.py: using CellId 23753 21:11:46.879796 tst mo_mt_call.py: using BVCI 23754 21:11:47.014946 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:47.027724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:47.040418 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:47.053621 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:47.070572 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:47.086338 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:47.224254 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:47.348925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:47.835942 run create_hlr_db(pid=15711): Launched 21:11:47.963640 bus /sierra_2: Setting Powered False 21:11:49.027210 run create_hlr_db(pid=15711): Terminated: ok {rc=0} 21:11:49.467403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15713): Launched 21:11:49.781406 run osmo-hlr_10.42.42.2(pid=15714): Launched 21:11:49.900877 run osmo-stp_10.42.42.5: Starting osmo-stp 21:11:50.442362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15716): Launched 21:11:50.757322 run osmo-stp_10.42.42.5(pid=15717): Launched 21:11:50.876299 run osmo-msc_10.42.42.6: Starting osmo-msc 21:11:51.446358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15719): Launched 21:11:51.761459 run osmo-msc_10.42.42.6(pid=15720): Launched 21:11:51.937276 run osmo-stp_10.42.42.5(pid=15717): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15717)] 21:11:52.070174 run osmo-stp_10.42.42.5(pid=15717): stdout: | (launched: 2022-12-09_21:11:50.699421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:52.203209 run osmo-stp_10.42.42.5(pid=15717): stderr: | 20221209211150888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211150888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211150888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211150889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211150889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211150889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211150889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:52.336929 run osmo-stp_10.42.42.5(pid=15717): stdout: | (launched: 2022-12-09_21:11:50.699421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:11:52.462796 run osmo-stp_10.42.42.5(pid=15717): stderr: | 20221209211150888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211150888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211150888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211150889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211150889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211150889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211150889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:11:52.612923 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15717): Process ended prematurely: osmo-stp_10.42.42.5(pid=15717) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15717)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 21:11:52.622464 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 21:11:52.649909 run osmo-hlr_10.42.42.2(pid=15714): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15714)] 21:11:52.698956 run osmo-hlr_10.42.42.2(pid=15714): stdout: | (launched: 2022-12-09_21:11:49.723539) 21:11:52.749905 run osmo-hlr_10.42.42.2(pid=15714): stderr: | 20221209211149916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211149916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211149916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211149916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211149916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211149916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211149928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211149936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211149937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211149937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:11:52.820667 run osmo-msc_10.42.42.6(pid=15720): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15720)] 21:11:52.869400 run osmo-msc_10.42.42.6(pid=15720): stdout: | (launched: 2022-12-09_21:11:51.703949) 21:11:52.919776 run osmo-msc_10.42.42.6(pid=15720): stderr: | 20221209211152023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211152023 DLGLOBAL DEBUG validating counter group 0x7f3bcd21bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211152023 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211152024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211152024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211152024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211152026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211152026 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211152026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211152026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:11:52.970479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15713): Terminating (SIGTERM) 21:11:53.010976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15716): Terminating (SIGTERM) 21:11:53.051499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15719): Terminating (SIGTERM) 21:11:53.092454 --- ParallelTerminationStrategy: PID 15713 died... 21:11:53.111933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15713): Terminated: ok {rc=0} 21:11:53.157055 --- ParallelTerminationStrategy: PID 15716 died... 21:11:53.176152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15716): Terminated: ok {rc=0} 21:11:53.221197 --- ParallelTerminationStrategy: PID 15719 died... 21:11:53.240512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15719): Terminated: ok {rc=0} 21:11:53.325741 bus /sierra_3: Setting Powered False 21:11:54.423567 bus /sierra_3: Setting Powered False 21:11:55.537559 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 21:11:56.683007 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:56.695074 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 21:11:56.761297 tst mo_mt_call_osmux.py: using LAC 23754 21:11:56.885394 tst mo_mt_call_osmux.py: using RAC 39 21:11:57.011605 tst mo_mt_call_osmux.py: using CellId 23754 21:11:57.138401 tst mo_mt_call_osmux.py: using BVCI 23755 21:11:57.253393 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:57.264706 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:57.276115 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:57.287601 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:57.299008 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 21:11:57.310261 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:57.428423 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 21:11:57.548122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:11:58.036317 run create_hlr_db(pid=15722): Launched 21:11:58.164163 bus /sierra_2: Setting Powered False 21:11:59.227745 run create_hlr_db(pid=15722): Terminated: ok {rc=0} 21:11:59.648348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15724): Launched 21:11:59.941205 run osmo-hlr_10.42.42.2(pid=15725): Launched 21:12:00.052639 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:00.569361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15727): Launched 21:12:00.889750 run osmo-stp_10.42.42.5(pid=15728): Launched 21:12:01.156023 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:01.757523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15730): Launched 21:12:02.097617 run osmo-msc_10.42.42.6(pid=15731): Launched 21:12:02.330660 run osmo-stp_10.42.42.5(pid=15728): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15728)] 21:12:02.467816 run osmo-stp_10.42.42.5(pid=15728): stdout: | (launched: 2022-12-09_21:12:00.810799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:02.605102 run osmo-stp_10.42.42.5(pid=15728): stderr: | 20221209211201084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211201084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211201085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211201085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211201085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211201086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211201086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:02.739031 run osmo-stp_10.42.42.5(pid=15728): stdout: | (launched: 2022-12-09_21:12:00.810799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:02.867813 run osmo-stp_10.42.42.5(pid=15728): stderr: | 20221209211201084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211201084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211201085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211201085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211201085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211201086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211201086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:03.021310 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15728): Process ended prematurely: osmo-stp_10.42.42.5(pid=15728) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15728)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 21:12:03.030898 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 21:12:03.058614 run osmo-hlr_10.42.42.2(pid=15725): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15725)] 21:12:03.108100 run osmo-hlr_10.42.42.2(pid=15725): stdout: | (launched: 2022-12-09_21:11:59.887524) 21:12:03.159316 run osmo-hlr_10.42.42.2(pid=15725): stderr: | 20221209211200057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211200057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211200057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211200057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211200057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211200057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211200070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211200081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211200081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211200081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:03.231311 run osmo-msc_10.42.42.6(pid=15731): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15731)] 21:12:03.281337 run osmo-msc_10.42.42.6(pid=15731): stdout: | (launched: 2022-12-09_21:12:02.028662) 21:12:03.332375 run osmo-msc_10.42.42.6(pid=15731): stderr: | 20221209211202399 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211202399 DLGLOBAL DEBUG validating counter group 0x7f95a0b68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211202399 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211202399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211202400 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211202400 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211202402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211202402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211202402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211202402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:03.384013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15724): Terminating (SIGTERM) 21:12:03.425419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15727): Terminating (SIGTERM) 21:12:03.466744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15730): Terminating (SIGTERM) 21:12:03.508376 --- ParallelTerminationStrategy: PID 15724 died... 21:12:03.528539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15724): Terminated: ok {rc=0} 21:12:03.574464 --- ParallelTerminationStrategy: PID 15727 died... 21:12:03.593957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15727): Terminated: ok {rc=0} 21:12:03.639525 --- ParallelTerminationStrategy: PID 15730 died... 21:12:03.658917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15730): Terminated: ok {rc=0} 21:12:03.745112 bus /sierra_3: Setting Powered False 21:12:04.844521 bus /sierra_3: Setting Powered False 21:12:05.958137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 21:12:07.206046 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:07.213459 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 21:12:07.245469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 21:12:07.271813 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 21:12:07.322546 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 21:12:07.354119 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 21:12:07.380044 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 21:12:07.930957 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 21:12:07.978812 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:07.989905 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:12:08.054176 tst mo_mt_call.py: using LAC 23755 21:12:08.171618 tst mo_mt_call.py: using RAC 40 21:12:08.290418 tst mo_mt_call.py: using CellId 23755 21:12:08.413976 tst mo_mt_call.py: using BVCI 23756 21:12:08.524151 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:08.535234 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:08.546152 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:08.557323 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:08.568848 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:08.579950 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:08.695578 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:08.809589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:09.273522 run create_hlr_db(pid=15737): Launched 21:12:09.387985 bus /sierra_2: Setting Powered False 21:12:10.447219 run create_hlr_db(pid=15737): Terminated: ok {rc=0} 21:12:10.884192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15739): Launched 21:12:11.203615 run osmo-hlr_10.42.42.2(pid=15740): Launched 21:12:11.325622 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:11.876319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15742): Launched 21:12:12.197427 run osmo-stp_10.42.42.5(pid=15743): Launched 21:12:12.320141 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:12.904324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15745): Launched 21:12:13.223704 run osmo-msc_10.42.42.6(pid=15746): Launched 21:12:13.402205 run osmo-stp_10.42.42.5(pid=15743): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15743)] 21:12:13.535811 run osmo-stp_10.42.42.5(pid=15743): stdout: | (launched: 2022-12-09_21:12:12.139055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:13.671493 run osmo-stp_10.42.42.5(pid=15743): stderr: | 20221209211212328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211212328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211212328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211212329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211212329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211212330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211212330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:13.806239 run osmo-stp_10.42.42.5(pid=15743): stdout: | (launched: 2022-12-09_21:12:12.139055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:13.934087 run osmo-stp_10.42.42.5(pid=15743): stderr: | 20221209211212328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211212328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211212328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211212329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211212329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211212330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211212330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:14.087062 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15743): Process ended prematurely: osmo-stp_10.42.42.5(pid=15743) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15743)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 21:12:14.096510 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 21:12:14.124050 run osmo-hlr_10.42.42.2(pid=15740): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15740)] 21:12:14.173769 run osmo-hlr_10.42.42.2(pid=15740): stdout: | (launched: 2022-12-09_21:12:11.145591) 21:12:14.224439 run osmo-hlr_10.42.42.2(pid=15740): stderr: | 20221209211211340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211211340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211211340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211211340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211211340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211211340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211211370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211211380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211211381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211211381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:14.296022 run osmo-msc_10.42.42.6(pid=15746): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15746)] 21:12:14.345146 run osmo-msc_10.42.42.6(pid=15746): stdout: | (launched: 2022-12-09_21:12:13.165506) 21:12:14.395810 run osmo-msc_10.42.42.6(pid=15746): stderr: | 20221209211213487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211213487 DLGLOBAL DEBUG validating counter group 0x7f96b4240c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211213487 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211213487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211213487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211213487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211213489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211213490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211213490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211213490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:14.446949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15739): Terminating (SIGTERM) 21:12:14.487870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15742): Terminating (SIGTERM) 21:12:14.529073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15745): Terminating (SIGTERM) 21:12:14.570531 --- ParallelTerminationStrategy: PID 15739 died... 21:12:14.589804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15739): Terminated: ok {rc=0} 21:12:14.635198 --- ParallelTerminationStrategy: PID 15742 died... 21:12:14.654525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15742): Terminated: ok {rc=0} 21:12:14.699945 --- ParallelTerminationStrategy: PID 15745 died... 21:12:14.719162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15745): Terminated: ok {rc=0} 21:12:14.804745 bus /sierra_3: Setting Powered False 21:12:15.909572 bus /sierra_3: Setting Powered False 21:12:17.029506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 21:12:18.172527 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.184424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 21:12:18.256692 tst mo_mt_call_osmux.py: using LAC 23756 21:12:18.373269 tst mo_mt_call_osmux.py: using RAC 41 21:12:18.489388 tst mo_mt_call_osmux.py: using CellId 23756 21:12:18.605515 tst mo_mt_call_osmux.py: using BVCI 23757 21:12:18.714270 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.725414 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.736246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.747453 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.758777 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 21:12:18.769978 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:18.890405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 21:12:19.009710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:19.476288 run create_hlr_db(pid=15748): Launched 21:12:19.590590 bus /sierra_2: Setting Powered False 21:12:20.654361 run create_hlr_db(pid=15748): Terminated: ok {rc=0} 21:12:21.102856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Launched 21:12:21.423093 run osmo-hlr_10.42.42.2(pid=15751): Launched 21:12:21.545517 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:22.096704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Launched 21:12:22.416229 run osmo-stp_10.42.42.5(pid=15754): Launched 21:12:22.537808 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:23.117680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Launched 21:12:23.437273 run osmo-msc_10.42.42.6(pid=15757): Launched 21:12:23.615535 run osmo-stp_10.42.42.5(pid=15754): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] 21:12:23.750166 run osmo-stp_10.42.42.5(pid=15754): stdout: | (launched: 2022-12-09_21:12:22.357942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:23.885344 run osmo-stp_10.42.42.5(pid=15754): stderr: | 20221209211222548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211222548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211222549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211222549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211222550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211222550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211222550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:24.019033 run osmo-stp_10.42.42.5(pid=15754): stdout: | (launched: 2022-12-09_21:12:22.357942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:24.146496 run osmo-stp_10.42.42.5(pid=15754): stderr: | 20221209211222548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211222548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211222549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211222549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211222550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211222550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211222550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:24.299590 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15754): Process ended prematurely: osmo-stp_10.42.42.5(pid=15754) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 21:12:24.309154 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:12:24.336691 run osmo-hlr_10.42.42.2(pid=15751): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15751)] 21:12:24.386052 run osmo-hlr_10.42.42.2(pid=15751): stdout: | (launched: 2022-12-09_21:12:21.364763) 21:12:24.436820 run osmo-hlr_10.42.42.2(pid=15751): stderr: | 20221209211221560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211221560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211221560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211221560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211221560 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211221560 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211221583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211221593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211221593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211221593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:24.508002 run osmo-msc_10.42.42.6(pid=15757): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15757)] 21:12:24.557095 run osmo-msc_10.42.42.6(pid=15757): stdout: | (launched: 2022-12-09_21:12:23.378649) 21:12:24.607737 run osmo-msc_10.42.42.6(pid=15757): stderr: | 20221209211223699 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211223699 DLGLOBAL DEBUG validating counter group 0x7f12184e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211223699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211223699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211223699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211223699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211223701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211223702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211223702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211223702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:24.658764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Terminating (SIGTERM) 21:12:24.699791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Terminating (SIGTERM) 21:12:24.740771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Terminating (SIGTERM) 21:12:24.782664 --- ParallelTerminationStrategy: PID 15750 died... 21:12:24.802332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Terminated: ok {rc=0} 21:12:24.847803 --- ParallelTerminationStrategy: PID 15753 died... 21:12:24.867096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Terminated: ok {rc=0} 21:12:24.912396 --- ParallelTerminationStrategy: PID 15756 died... 21:12:24.931651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Terminated: ok {rc=0} 21:12:25.018191 bus /sierra_3: Setting Powered False 21:12:26.115679 bus /sierra_3: Setting Powered False 21:12:27.232416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 21:12:28.483299 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:28.491028 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 21:12:28.523767 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 21:12:28.550790 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 21:12:28.602553 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 21:12:28.635065 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 21:12:28.662179 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 21:12:29.215203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 21:12:29.266490 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.278101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:12:29.345435 tst mo_mt_call.py: using LAC 23757 21:12:29.466315 tst mo_mt_call.py: using RAC 42 21:12:29.586309 tst mo_mt_call.py: using CellId 23757 21:12:29.706111 tst mo_mt_call.py: using BVCI 23758 21:12:29.817457 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.828540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.839424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.850647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.861891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:29.873067 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:29.986580 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:30.100500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:30.564218 run create_hlr_db(pid=15762): Launched 21:12:30.678166 bus /sierra_2: Setting Powered False 21:12:31.736068 run create_hlr_db(pid=15762): Terminated: ok {rc=0} 21:12:32.177842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15764): Launched 21:12:32.481836 run osmo-hlr_10.42.42.2(pid=15765): Launched 21:12:32.597044 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:33.125840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15767): Launched 21:12:33.425892 run osmo-stp_10.42.42.5(pid=15768): Launched 21:12:33.539780 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:34.080176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15770): Launched 21:12:34.380414 run osmo-msc_10.42.42.6(pid=15771): Launched 21:12:34.548473 run osmo-stp_10.42.42.5(pid=15768): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15768)] 21:12:34.676129 run osmo-stp_10.42.42.5(pid=15768): stdout: | (launched: 2022-12-09_21:12:33.370691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:34.803364 run osmo-stp_10.42.42.5(pid=15768): stderr: | 20221209211233536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211233536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211233537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211233537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211233537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211233538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211233538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:34.928148 run osmo-stp_10.42.42.5(pid=15768): stdout: | (launched: 2022-12-09_21:12:33.370691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:35.047431 run osmo-stp_10.42.42.5(pid=15768): stderr: | 20221209211233536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211233536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211233537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211233537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211233537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211233538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211233538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:35.190797 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15768): Process ended prematurely: osmo-stp_10.42.42.5(pid=15768) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15768)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 21:12:35.199511 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:12:35.226082 run osmo-hlr_10.42.42.2(pid=15765): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15765)] 21:12:35.273351 run osmo-hlr_10.42.42.2(pid=15765): stdout: | (launched: 2022-12-09_21:12:32.427135) 21:12:35.322041 run osmo-hlr_10.42.42.2(pid=15765): stderr: | 20221209211232599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211232599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211232599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211232599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211232599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211232599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211232609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211232618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211232618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211232618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:35.390251 run osmo-msc_10.42.42.6(pid=15771): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15771)] 21:12:35.437441 run osmo-msc_10.42.42.6(pid=15771): stdout: | (launched: 2022-12-09_21:12:34.325186) 21:12:35.486060 run osmo-msc_10.42.42.6(pid=15771): stderr: | 20221209211234594 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211234594 DLGLOBAL DEBUG validating counter group 0x7f13c90b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211234594 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211234594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211234594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211234594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211234596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211234596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211234596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211234597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:35.535410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15764): Terminating (SIGTERM) 21:12:35.574447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15767): Terminating (SIGTERM) 21:12:35.613519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15770): Terminating (SIGTERM) 21:12:35.653067 --- ParallelTerminationStrategy: PID 15764 died... 21:12:35.671746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15764): Terminated: ok {rc=0} 21:12:35.715313 --- ParallelTerminationStrategy: PID 15767 died... 21:12:35.733495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15767): Terminated: ok {rc=0} 21:12:35.776835 --- ParallelTerminationStrategy: PID 15770 died... 21:12:35.795493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15770): Terminated: ok {rc=0} 21:12:35.884193 bus /sierra_3: Setting Powered False 21:12:36.981525 bus /sierra_3: Setting Powered False 21:12:38.097529 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 21:12:39.245611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.258432 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 21:12:39.326444 tst mo_mt_call_osmux.py: using LAC 23758 21:12:39.453815 tst mo_mt_call_osmux.py: using RAC 43 21:12:39.580136 tst mo_mt_call_osmux.py: using CellId 23758 21:12:39.706415 tst mo_mt_call_osmux.py: using BVCI 23759 21:12:39.824819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.836573 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.848226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.859780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.871303 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 21:12:39.882714 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:40.001428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 21:12:40.122197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:40.589362 run create_hlr_db(pid=15774): Launched 21:12:40.705410 bus /sierra_2: Setting Powered False 21:12:41.765855 run create_hlr_db(pid=15774): Terminated: ok {rc=0} 21:12:42.205745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Launched 21:12:42.527221 run osmo-hlr_10.42.42.2(pid=15777): Launched 21:12:42.649277 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:43.208917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Launched 21:12:43.529911 run osmo-stp_10.42.42.5(pid=15780): Launched 21:12:43.651602 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:44.230524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Launched 21:12:44.551656 run osmo-msc_10.42.42.6(pid=15783): Launched 21:12:44.730567 run osmo-stp_10.42.42.5(pid=15780): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] 21:12:44.865099 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-09_21:12:43.470772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:45.000250 run osmo-stp_10.42.42.5(pid=15780): stderr: | 20221209211243659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211243659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211243660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211243660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211243661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211243661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211243661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:45.135133 run osmo-stp_10.42.42.5(pid=15780): stdout: | (launched: 2022-12-09_21:12:43.470772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:45.264062 run osmo-stp_10.42.42.5(pid=15780): stderr: | 20221209211243659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211243659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211243660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211243660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211243661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211243661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211243661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:45.417583 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 21:12:45.427332 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 21:12:45.454755 run osmo-hlr_10.42.42.2(pid=15777): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15777)] 21:12:45.503785 run osmo-hlr_10.42.42.2(pid=15777): stdout: | (launched: 2022-12-09_21:12:42.468628) 21:12:45.554873 run osmo-hlr_10.42.42.2(pid=15777): stderr: | 20221209211242664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211242664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211242664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211242664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211242664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211242664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211242677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211242686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211242686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211242686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:45.626079 run osmo-msc_10.42.42.6(pid=15783): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15783)] 21:12:45.675281 run osmo-msc_10.42.42.6(pid=15783): stdout: | (launched: 2022-12-09_21:12:44.493053) 21:12:45.725763 run osmo-msc_10.42.42.6(pid=15783): stderr: | 20221209211244813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211244813 DLGLOBAL DEBUG validating counter group 0x7fb705b68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211244814 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211244814 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211244814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211244814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211244816 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211244816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211244816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211244816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:45.776529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminating (SIGTERM) 21:12:45.817440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminating (SIGTERM) 21:12:45.876105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminating (SIGTERM) 21:12:45.932438 --- ParallelTerminationStrategy: PID 15776 died... 21:12:45.952346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15776): Terminated: ok {rc=0} 21:12:46.003350 --- ParallelTerminationStrategy: PID 15779 died... 21:12:46.032191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15779): Terminated: ok {rc=0} 21:12:46.090940 --- ParallelTerminationStrategy: PID 15782 died... 21:12:46.115692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15782): Terminated: ok {rc=0} 21:12:46.222669 bus /sierra_3: Setting Powered False 21:12:47.323710 bus /sierra_3: Setting Powered False 21:12:48.437899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 21:12:49.681194 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:12:49.688464 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 21:12:49.720474 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 21:12:49.746804 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 21:12:49.797864 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 21:12:49.830072 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 21:12:49.856259 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 21:12:50.406704 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 21:12:50.455624 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:50.466724 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:12:50.531939 tst mo_mt_call.py: using LAC 23759 21:12:50.651074 tst mo_mt_call.py: using RAC 44 21:12:50.771118 tst mo_mt_call.py: using CellId 23759 21:12:50.890831 tst mo_mt_call.py: using BVCI 23760 21:12:50.999581 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:51.010681 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:51.021858 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:51.032898 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:51.044155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:12:51.055159 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:51.173444 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:12:51.293630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:12:51.789895 run create_hlr_db(pid=15788): Launched 21:12:51.923543 bus /sierra_2: Setting Powered False 21:12:52.983274 run create_hlr_db(pid=15788): Terminated: ok {rc=0} 21:12:53.401855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15790): Launched 21:12:53.701241 run osmo-hlr_10.42.42.2(pid=15791): Launched 21:12:53.815083 run osmo-stp_10.42.42.5: Starting osmo-stp 21:12:54.340875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15793): Launched 21:12:54.640361 run osmo-stp_10.42.42.5(pid=15794): Launched 21:12:54.754035 run osmo-msc_10.42.42.6: Starting osmo-msc 21:12:55.295800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15796): Launched 21:12:55.594363 run osmo-msc_10.42.42.6(pid=15797): Launched 21:12:55.761716 run osmo-stp_10.42.42.5(pid=15794): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15794)] 21:12:55.888414 run osmo-stp_10.42.42.5(pid=15794): stdout: | (launched: 2022-12-09_21:12:54.585249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:56.015003 run osmo-stp_10.42.42.5(pid=15794): stderr: | 20221209211254752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211254752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211254752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211254753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211254753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211254753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211254753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:56.139736 run osmo-stp_10.42.42.5(pid=15794): stdout: | (launched: 2022-12-09_21:12:54.585249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:12:56.258741 run osmo-stp_10.42.42.5(pid=15794): stderr: | 20221209211254752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211254752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211254752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211254753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211254753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211254753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211254753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:12:56.401354 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15794): Process ended prematurely: osmo-stp_10.42.42.5(pid=15794) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15794)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 21:12:56.410319 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 21:12:56.437039 run osmo-hlr_10.42.42.2(pid=15791): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15791)] 21:12:56.483744 run osmo-hlr_10.42.42.2(pid=15791): stdout: | (launched: 2022-12-09_21:12:53.646169) 21:12:56.532170 run osmo-hlr_10.42.42.2(pid=15791): stderr: | 20221209211253819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211253819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211253820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211253820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211253820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211253820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211253832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211253841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211253841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211253841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:12:56.600001 run osmo-msc_10.42.42.6(pid=15797): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15797)] 21:12:56.646708 run osmo-msc_10.42.42.6(pid=15797): stdout: | (launched: 2022-12-09_21:12:55.539475) 21:12:56.695030 run osmo-msc_10.42.42.6(pid=15797): stderr: | 20221209211255808 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211255808 DLGLOBAL DEBUG validating counter group 0x7f66c4e26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211255808 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211255808 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211255808 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211255809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211255810 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211255811 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211255811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211255811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:12:56.743686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15790): Terminating (SIGTERM) 21:12:56.782482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15793): Terminating (SIGTERM) 21:12:56.821476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15796): Terminating (SIGTERM) 21:12:56.861242 --- ParallelTerminationStrategy: PID 15790 died... 21:12:56.879968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15790): Terminated: ok {rc=0} 21:12:56.923402 --- ParallelTerminationStrategy: PID 15793 died... 21:12:56.941751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15793): Terminated: ok {rc=0} 21:12:56.984885 --- ParallelTerminationStrategy: PID 15796 died... 21:12:57.003672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15796): Terminated: ok {rc=0} 21:12:57.085243 bus /sierra_3: Setting Powered False 21:12:58.182794 bus /sierra_3: Setting Powered False 21:12:59.296654 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 21:13:00.438472 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:00.450342 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 21:13:00.516359 tst mo_mt_call_osmux.py: using LAC 23760 21:13:00.635498 tst mo_mt_call_osmux.py: using RAC 45 21:13:00.755614 tst mo_mt_call_osmux.py: using CellId 23760 21:13:00.902352 tst mo_mt_call_osmux.py: using BVCI 23761 21:13:01.022696 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:01.034947 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:01.047107 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:01.061161 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:01.074168 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 21:13:01.086203 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:13:01.204084 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 21:13:01.323257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:01.849707 run create_hlr_db(pid=15799): Launched 21:13:02.004371 bus /sierra_2: Setting Powered False 21:13:03.068515 run create_hlr_db(pid=15799): Terminated: ok {rc=0} 21:13:03.501768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Launched 21:13:03.823592 run osmo-hlr_10.42.42.2(pid=15802): Launched 21:13:03.945702 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:04.496419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Launched 21:13:04.816781 run osmo-stp_10.42.42.5(pid=15805): Launched 21:13:04.938947 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:05.519148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Launched 21:13:05.839898 run osmo-msc_10.42.42.6(pid=15808): Launched 21:13:06.018350 run osmo-stp_10.42.42.5(pid=15805): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] 21:13:06.152426 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-09_21:13:04.758396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:06.287763 run osmo-stp_10.42.42.5(pid=15805): stderr: | 20221209211304946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211304946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211304946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211304947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211304947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211304947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211304947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:06.422458 run osmo-stp_10.42.42.5(pid=15805): stdout: | (launched: 2022-12-09_21:13:04.758396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:06.550649 run osmo-stp_10.42.42.5(pid=15805): stderr: | 20221209211304946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211304946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211304946 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211304947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211304947 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211304947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211304947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:06.703980 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 21:13:06.713762 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:13:06.741268 run osmo-hlr_10.42.42.2(pid=15802): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15802)] 21:13:06.790413 run osmo-hlr_10.42.42.2(pid=15802): stdout: | (launched: 2022-12-09_21:13:03.764879) 21:13:06.841453 run osmo-hlr_10.42.42.2(pid=15802): stderr: | 20221209211303959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211303959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211303959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211303959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211303960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211303960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211303973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211303983 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211303983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211303983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:06.912530 run osmo-msc_10.42.42.6(pid=15808): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15808)] 21:13:06.961559 run osmo-msc_10.42.42.6(pid=15808): stdout: | (launched: 2022-12-09_21:13:05.781769) 21:13:07.012071 run osmo-msc_10.42.42.6(pid=15808): stderr: | 20221209211306102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211306102 DLGLOBAL DEBUG validating counter group 0x7f0828d00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211306102 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211306102 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211306102 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211306103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211306104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211306105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211306105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211306105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:07.062999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminating (SIGTERM) 21:13:07.103890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminating (SIGTERM) 21:13:07.144905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Terminating (SIGTERM) 21:13:07.186341 --- ParallelTerminationStrategy: PID 15801 died... 21:13:07.206055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15801): Terminated: ok {rc=0} 21:13:07.251602 --- ParallelTerminationStrategy: PID 15804 died... 21:13:07.271420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15804): Terminated: ok {rc=0} 21:13:07.317250 --- ParallelTerminationStrategy: PID 15807 died... 21:13:07.336521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15807): Terminated: ok {rc=0} 21:13:07.422517 bus /sierra_3: Setting Powered False 21:13:08.519594 bus /sierra_3: Setting Powered False 21:13:09.635106 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 21:13:10.879973 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:10.887223 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:13:10.919122 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 21:13:10.945178 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:13:10.997634 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:13:11.030077 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 21:13:11.056059 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:13:11.606894 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 21:13:11.655507 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:11.666727 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:13:11.733190 tst mo_mt_call.py: using LAC 23761 21:13:11.852122 tst mo_mt_call.py: using RAC 46 21:13:11.980035 tst mo_mt_call.py: using CellId 23761 21:13:12.107337 tst mo_mt_call.py: using BVCI 23762 21:13:12.223930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:12.235693 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:12.247279 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:12.259095 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:12.271481 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:12.283108 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:12.398273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:12.517352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:12.981906 run create_hlr_db(pid=15814): Launched 21:13:13.096648 bus /sierra_2: Setting Powered False 21:13:14.161324 run create_hlr_db(pid=15814): Terminated: ok {rc=0} 21:13:14.590239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15816): Launched 21:13:14.889727 run osmo-hlr_10.42.42.2(pid=15817): Launched 21:13:15.003590 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:15.523828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15819): Launched 21:13:15.821963 run osmo-stp_10.42.42.5(pid=15820): Launched 21:13:16.077486 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:16.723640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15822): Launched 21:13:17.032622 run osmo-msc_10.42.42.6(pid=15823): Launched 21:13:17.244714 run osmo-stp_10.42.42.5(pid=15820): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15820)] 21:13:17.439092 run osmo-stp_10.42.42.5(pid=15820): stdout: | (launched: 2022-12-09_21:13:15.767314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:17.582311 run osmo-stp_10.42.42.5(pid=15820): stderr: | 20221209211316005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211316005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211316005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211316006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211316006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211316006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211316006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:17.719851 run osmo-stp_10.42.42.5(pid=15820): stdout: | (launched: 2022-12-09_21:13:15.767314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:17.849802 run osmo-stp_10.42.42.5(pid=15820): stderr: | 20221209211316005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211316005 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211316005 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211316006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211316006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211316006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211316006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:18.003731 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15820): Process ended prematurely: osmo-stp_10.42.42.5(pid=15820) [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15820)] [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 21:13:18.013483 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 21:13:18.041135 run osmo-hlr_10.42.42.2(pid=15817): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15817)] 21:13:18.093309 run osmo-hlr_10.42.42.2(pid=15817): stdout: | (launched: 2022-12-09_21:13:14.834755) 21:13:18.141784 run osmo-hlr_10.42.42.2(pid=15817): stderr: | 20221209211315007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211315007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211315007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211315007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211315007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211315007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211315019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211315030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211315030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211315030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:18.209736 run osmo-msc_10.42.42.6(pid=15823): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15823)] 21:13:18.256423 run osmo-msc_10.42.42.6(pid=15823): stdout: | (launched: 2022-12-09_21:13:16.974785) 21:13:18.304786 run osmo-msc_10.42.42.6(pid=15823): stderr: | 20221209211317545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211317545 DLGLOBAL DEBUG validating counter group 0x7fa683b1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211317545 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211317545 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211317546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211317546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211317547 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211317548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211317548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211317548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:18.353466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15816): Terminating (SIGTERM) 21:13:18.392544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15819): Terminating (SIGTERM) 21:13:18.431503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15822): Terminating (SIGTERM) 21:13:18.470928 --- ParallelTerminationStrategy: PID 15816 died... 21:13:18.489616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15816): Terminated: ok {rc=0} 21:13:18.533289 --- ParallelTerminationStrategy: PID 15819 died... 21:13:18.551574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15819): Terminated: ok {rc=0} 21:13:18.594970 --- ParallelTerminationStrategy: PID 15822 died... 21:13:18.613348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15822): Terminated: ok {rc=0} 21:13:18.697293 bus /sierra_3: Setting Powered False 21:13:19.795110 bus /sierra_3: Setting Powered False 21:13:20.908202 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 21:13:22.052450 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.064325 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:13:22.130501 tst mo_mt_call_osmux.py: using LAC 23762 21:13:22.249377 tst mo_mt_call_osmux.py: using RAC 47 21:13:22.370613 tst mo_mt_call_osmux.py: using CellId 23762 21:13:22.497838 tst mo_mt_call_osmux.py: using BVCI 23763 21:13:22.617770 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.629523 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.641060 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.652942 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.665053 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 21:13:22.677105 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:22.794850 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:13:22.913675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:23.414396 run create_hlr_db(pid=15825): Launched 21:13:23.544795 bus /sierra_2: Setting Powered False 21:13:24.608499 run create_hlr_db(pid=15825): Terminated: ok {rc=0} 21:13:25.037924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Launched 21:13:25.338136 run osmo-hlr_10.42.42.2(pid=15828): Launched 21:13:25.452333 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:25.969126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Launched 21:13:26.269718 run osmo-stp_10.42.42.5(pid=15831): Launched 21:13:26.383890 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:26.926294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15833): Launched 21:13:27.225681 run osmo-msc_10.42.42.6(pid=15834): Launched 21:13:27.393389 run osmo-stp_10.42.42.5(pid=15831): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15831)] 21:13:27.520522 run osmo-stp_10.42.42.5(pid=15831): stdout: | (launched: 2022-12-09_21:13:26.214387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:27.647485 run osmo-stp_10.42.42.5(pid=15831): stderr: | 20221209211326383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211326383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211326383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211326383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211326384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211326384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211326384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:27.772310 run osmo-stp_10.42.42.5(pid=15831): stdout: | (launched: 2022-12-09_21:13:26.214387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:27.891940 run osmo-stp_10.42.42.5(pid=15831): stderr: | 20221209211326383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211326383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211326383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211326383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211326384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211326384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211326384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:28.035335 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15831): Process ended prematurely: osmo-stp_10.42.42.5(pid=15831) [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15831)] [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 21:13:28.044366 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 21:13:28.070635 run osmo-hlr_10.42.42.2(pid=15828): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15828)] 21:13:28.118233 run osmo-hlr_10.42.42.2(pid=15828): stdout: | (launched: 2022-12-09_21:13:25.282740) 21:13:28.166992 run osmo-hlr_10.42.42.2(pid=15828): stderr: | 20221209211325456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211325456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211325456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211325456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211325456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211325456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211325471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211325483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211325483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211325483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:28.235067 run osmo-msc_10.42.42.6(pid=15834): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15834)] 21:13:28.281878 run osmo-msc_10.42.42.6(pid=15834): stdout: | (launched: 2022-12-09_21:13:27.170280) 21:13:28.330226 run osmo-msc_10.42.42.6(pid=15834): stderr: | 20221209211327440 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211327440 DLGLOBAL DEBUG validating counter group 0x7f1cbd66cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211327440 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211327440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211327440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211327440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211327442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211327443 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211327443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211327443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:28.379258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Terminating (SIGTERM) 21:13:28.418393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Terminating (SIGTERM) 21:13:28.457600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15833): Terminating (SIGTERM) 21:13:28.497103 --- ParallelTerminationStrategy: PID 15827 died... 21:13:28.515809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Terminated: ok {rc=0} 21:13:28.559659 --- ParallelTerminationStrategy: PID 15830 died... 21:13:28.578019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Terminated: ok {rc=0} 21:13:28.621894 --- ParallelTerminationStrategy: PID 15833 died... 21:13:28.640380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15833): Terminated: ok {rc=0} 21:13:28.725509 bus /sierra_3: Setting Powered False 21:13:29.823213 bus /sierra_3: Setting Powered False 21:13:30.933514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:13:32.213280 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:32.223525 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:13:32.256646 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 21:13:32.284671 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 21:13:32.336229 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:13:32.369058 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 21:13:32.396467 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 21:13:32.951073 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 21:13:33.000714 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.012130 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:13:33.060750 tst mo_mt_call.py: using LAC 23763 21:13:33.180711 tst mo_mt_call.py: using RAC 48 21:13:33.298458 tst mo_mt_call.py: using CellId 23763 21:13:33.418444 tst mo_mt_call.py: using BVCI 23764 21:13:33.527976 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.539299 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.550392 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.561769 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.573166 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:33.584479 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:33.703461 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:33.818499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:34.284753 run create_hlr_db(pid=15840): Launched 21:13:34.398551 bus /sierra_2: Setting Powered False 21:13:35.459220 run create_hlr_db(pid=15840): Terminated: ok {rc=0} 21:13:35.877931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15842): Launched 21:13:36.176924 run osmo-hlr_10.42.42.2(pid=15843): Launched 21:13:36.291261 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:36.817672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Launched 21:13:37.117641 run osmo-stp_10.42.42.5(pid=15846): Launched 21:13:37.232165 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:37.774088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15848): Launched 21:13:38.073118 run osmo-msc_10.42.42.6(pid=15849): Launched 21:13:38.240308 run osmo-stp_10.42.42.5(pid=15846): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15846)] 21:13:38.367739 run osmo-stp_10.42.42.5(pid=15846): stdout: | (launched: 2022-12-09_21:13:37.062363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:38.494811 run osmo-stp_10.42.42.5(pid=15846): stderr: | 20221209211337229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211337229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211337229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211337230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211337230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211337230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211337230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:38.619544 run osmo-stp_10.42.42.5(pid=15846): stdout: | (launched: 2022-12-09_21:13:37.062363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:38.738872 run osmo-stp_10.42.42.5(pid=15846): stderr: | 20221209211337229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211337229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211337229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211337230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211337230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211337230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211337230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:38.882224 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15846): Process ended prematurely: osmo-stp_10.42.42.5(pid=15846) [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15846)] [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 21:13:38.891184 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 21:13:38.917719 run osmo-hlr_10.42.42.2(pid=15843): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15843)] 21:13:38.964681 run osmo-hlr_10.42.42.2(pid=15843): stdout: | (launched: 2022-12-09_21:13:36.121908) 21:13:39.013498 run osmo-hlr_10.42.42.2(pid=15843): stderr: | 20221209211336294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211336294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211336294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211336294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211336294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211336294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211336306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211336317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211336317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211336317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:39.081545 run osmo-msc_10.42.42.6(pid=15849): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15849)] 21:13:39.128597 run osmo-msc_10.42.42.6(pid=15849): stdout: | (launched: 2022-12-09_21:13:38.018100) 21:13:39.177228 run osmo-msc_10.42.42.6(pid=15849): stderr: | 20221209211338287 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211338287 DLGLOBAL DEBUG validating counter group 0x7fda72625c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211338287 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211338288 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211338288 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211338288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211338290 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211338290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211338290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211338290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:39.226328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15842): Terminating (SIGTERM) 21:13:39.265796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Terminating (SIGTERM) 21:13:39.305212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15848): Terminating (SIGTERM) 21:13:39.345000 --- ParallelTerminationStrategy: PID 15842 died... 21:13:39.363629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15842): Terminated: ok {rc=0} 21:13:39.407713 --- ParallelTerminationStrategy: PID 15845 died... 21:13:39.426098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15845): Terminated: ok {rc=0} 21:13:39.469519 --- ParallelTerminationStrategy: PID 15848 died... 21:13:39.487872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15848): Terminated: ok {rc=0} 21:13:39.572347 bus /sierra_3: Setting Powered False 21:13:40.670617 bus /sierra_3: Setting Powered False 21:13:41.784407 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 21:13:42.928469 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:42.940516 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:13:42.989749 tst mo_mt_call_osmux.py: using LAC 23764 21:13:43.110037 tst mo_mt_call_osmux.py: using RAC 49 21:13:43.230116 tst mo_mt_call_osmux.py: using CellId 23764 21:13:43.347503 tst mo_mt_call_osmux.py: using BVCI 23765 21:13:43.457941 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:43.469572 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:43.480554 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:43.491709 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:43.503886 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 21:13:43.515285 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:43.631076 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 21:13:43.750206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:44.250049 run create_hlr_db(pid=15851): Launched 21:13:44.380463 bus /sierra_2: Setting Powered False 21:13:45.444230 run create_hlr_db(pid=15851): Terminated: ok {rc=0} 21:13:45.909938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Launched 21:13:46.245932 run osmo-hlr_10.42.42.2(pid=15854): Launched 21:13:46.488428 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:47.150236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Launched 21:13:47.450009 run osmo-stp_10.42.42.5(pid=15857): Launched 21:13:47.565394 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:48.109155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Launched 21:13:48.410068 run osmo-msc_10.42.42.6(pid=15860): Launched 21:13:48.579157 run osmo-stp_10.42.42.5(pid=15857): ERR: Terminated: ERROR {rc=1} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] 21:13:48.706323 run osmo-stp_10.42.42.5(pid=15857): stdout: | (launched: 2022-12-09_21:13:47.394735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:48.832877 run osmo-stp_10.42.42.5(pid=15857): stderr: | 20221209211347563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211347563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211347563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211347564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211347564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211347564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211347564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:48.957886 run osmo-stp_10.42.42.5(pid=15857): stdout: | (launched: 2022-12-09_21:13:47.394735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:49.077298 run osmo-stp_10.42.42.5(pid=15857): stderr: | 20221209211347563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211347563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211347563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211347564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211347564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211347564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211347564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:49.220475 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15857): Process ended prematurely: osmo-stp_10.42.42.5(pid=15857) [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 21:13:49.229394 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 21:13:49.256032 run osmo-hlr_10.42.42.2(pid=15854): ERR: Terminated: ERROR {rc=237} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15854)] 21:13:49.303942 run osmo-hlr_10.42.42.2(pid=15854): stdout: | (launched: 2022-12-09_21:13:46.180383) 21:13:49.352669 run osmo-hlr_10.42.42.2(pid=15854): stderr: | 20221209211346489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211346489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211346489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211346490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211346490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211346490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211346501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211346518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211346518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211346518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:13:49.420705 run osmo-msc_10.42.42.6(pid=15860): ERR: Terminated: ERROR {rc=2} [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15860)] 21:13:49.467579 run osmo-msc_10.42.42.6(pid=15860): stdout: | (launched: 2022-12-09_21:13:48.354477) 21:13:49.516344 run osmo-msc_10.42.42.6(pid=15860): stderr: | 20221209211348621 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211348621 DLGLOBAL DEBUG validating counter group 0x7f6944bb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211348621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211348621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211348622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211348622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211348623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211348624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211348624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211348624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:13:49.565452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Terminating (SIGTERM) 21:13:49.604526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Terminating (SIGTERM) 21:13:49.644467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Terminating (SIGTERM) 21:13:49.684531 --- ParallelTerminationStrategy: PID 15853 died... 21:13:49.703207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15853): Terminated: ok {rc=0} 21:13:49.747087 --- ParallelTerminationStrategy: PID 15856 died... 21:13:49.765762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15856): Terminated: ok {rc=0} 21:13:49.809874 --- ParallelTerminationStrategy: PID 15859 died... 21:13:49.828473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15859): Terminated: ok {rc=0} 21:13:49.911785 bus /sierra_3: Setting Powered False 21:13:51.009889 bus /sierra_3: Setting Powered False 21:13:52.126240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 emergency:nanobts+band-900 --------------------------------------------------------------------- 21:13:53.378340 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:13:53.383503 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:13:53.416136 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 21:13:53.442711 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:13:53.525229 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:13:53.556895 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 21:13:53.583126 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:13:54.166639 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2364 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 21:13:54.171777 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.182401 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:13:54.228923 tst emergency_mo_mt_call.py: using LAC 23765 21:13:54.343756 tst emergency_mo_mt_call.py: using RAC 50 21:13:54.459425 tst emergency_mo_mt_call.py: using CellId 23765 21:13:54.577217 tst emergency_mo_mt_call.py: using BVCI 23766 21:13:54.686334 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.696930 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.707377 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.718487 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.729454 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:13:54.740216 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.857539 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:13:54.980094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:13:55.472268 run create_hlr_db(pid=15865): Launched 21:13:55.600718 bus /sierra_2: Setting Powered False 21:13:56.664398 run create_hlr_db(pid=15865): Terminated: ok {rc=0} 21:13:57.088476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Launched 21:13:57.385182 run osmo-hlr_10.42.42.2(pid=15868): Launched 21:13:57.497535 run osmo-stp_10.42.42.5: Starting osmo-stp 21:13:58.011201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Launched 21:13:58.305529 run osmo-stp_10.42.42.5(pid=15871): Launched 21:13:58.426272 tst emergency_mo_mt_call.py: using MSISDN 7378 21:13:58.576006 run osmo-msc_10.42.42.6: Starting osmo-msc 21:13:59.105207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15873): Launched 21:13:59.399901 run osmo-msc_10.42.42.6(pid=15874): Launched 21:13:59.564653 run osmo-stp_10.42.42.5(pid=15871): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] 21:13:59.699107 run osmo-stp_10.42.42.5(pid=15871): stdout: | (launched: 2022-12-09_21:13:58.251048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:13:59.834464 run osmo-stp_10.42.42.5(pid=15871): stderr: | 20221209211358416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211358416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211358416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211358417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211358417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211358417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211358418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:13:59.965899 run osmo-stp_10.42.42.5(pid=15871): stdout: | (launched: 2022-12-09_21:13:58.251048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:00.092040 run osmo-stp_10.42.42.5(pid=15871): stderr: | 20221209211358416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211358416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211358416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211358417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211358417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211358417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211358418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:00.242607 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15871): Process ended prematurely: osmo-stp_10.42.42.5(pid=15871) [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 21:14:00.251493 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 21:14:00.278717 run osmo-hlr_10.42.42.2(pid=15868): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15868)] 21:14:00.329158 run osmo-hlr_10.42.42.2(pid=15868): stdout: | (launched: 2022-12-09_21:13:57.330605) 21:14:00.380332 run osmo-hlr_10.42.42.2(pid=15868): stderr: | 20221209211357504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211357504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211357504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211357504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211357504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211357504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211357515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211357524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211357524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211357524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:00.451362 run osmo-msc_10.42.42.6(pid=15874): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15874)] 21:14:00.500425 run osmo-msc_10.42.42.6(pid=15874): stdout: | (launched: 2022-12-09_21:13:59.345802) 21:14:00.551537 run osmo-msc_10.42.42.6(pid=15874): stderr: | 20221209211359616 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211359616 DLGLOBAL DEBUG validating counter group 0x7f14560dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211359616 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211359616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211359616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211359616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211359618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211359619 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211359619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211359619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:00.602835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Terminating (SIGTERM) 21:14:00.643917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Terminating (SIGTERM) 21:14:00.685088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15873): Terminating (SIGTERM) 21:14:00.726372 --- ParallelTerminationStrategy: PID 15867 died... 21:14:00.746063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Terminated: ok {rc=0} 21:14:00.791820 --- ParallelTerminationStrategy: PID 15870 died... 21:14:00.811398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Terminated: ok {rc=0} 21:14:00.857175 --- ParallelTerminationStrategy: PID 15873 died... 21:14:00.877056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15873): Terminated: ok {rc=0} 21:14:00.973790 bus /sierra_3: Setting Powered False 21:14:02.074370 bus /sierra_3: Setting Powered False 21:14:03.193115 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 21:14:04.279369 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.291295 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:04.341796 tst emergency_preemptive_call.py: using LAC 23766 21:14:04.471368 tst emergency_preemptive_call.py: using RAC 51 21:14:04.609355 tst emergency_preemptive_call.py: using CellId 23766 21:14:04.732678 tst emergency_preemptive_call.py: using BVCI 23767 21:14:04.846478 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.857763 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.868647 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.879745 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.890867 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 21:14:04.901976 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:05.016226 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:05.137139 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:05.250733 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:05.362506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:05.823017 run create_hlr_db(pid=15876): Launched 21:14:05.935469 bus /sierra_2: Setting Powered False 21:14:06.994910 run create_hlr_db(pid=15876): Terminated: ok {rc=0} 21:14:07.407499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Launched 21:14:07.702412 run osmo-hlr_10.42.42.2(pid=15879): Launched 21:14:07.815610 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:08.321949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Launched 21:14:08.615988 run osmo-stp_10.42.42.5(pid=15882): Launched 21:14:08.742229 tst emergency_preemptive_call.py: using MSISDN 7379 21:14:08.892434 run osmo-msc_10.42.42.6: Starting osmo-msc 21:14:09.421930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Launched 21:14:09.716141 run osmo-msc_10.42.42.6(pid=15885): Launched 21:14:09.883951 run osmo-stp_10.42.42.5(pid=15882): ERR: Terminated: ERROR {rc=1} [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] 21:14:10.009309 run osmo-stp_10.42.42.5(pid=15882): stdout: | (launched: 2022-12-09_21:14:08.561625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:10.135686 run osmo-stp_10.42.42.5(pid=15882): stderr: | 20221209211408727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211408727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211408728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211408728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211408729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211408729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211408729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:10.259199 run osmo-stp_10.42.42.5(pid=15882): stdout: | (launched: 2022-12-09_21:14:08.561625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:10.377495 run osmo-stp_10.42.42.5(pid=15882): stderr: | 20221209211408727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211408727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211408728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211408728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211408729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211408729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211408729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:10.518319 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15882): Process ended prematurely: osmo-stp_10.42.42.5(pid=15882) [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 21:14:10.526715 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 21:14:10.553054 run osmo-hlr_10.42.42.2(pid=15879): ERR: Terminated: ERROR {rc=237} [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15879)] 21:14:10.600663 run osmo-hlr_10.42.42.2(pid=15879): stdout: | (launched: 2022-12-09_21:14:07.647860) 21:14:10.649597 run osmo-hlr_10.42.42.2(pid=15879): stderr: | 20221209211407820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211407820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211407820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211407820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211407820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211407820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211407832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211407841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211407841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211407841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:10.717796 run osmo-msc_10.42.42.6(pid=15885): ERR: Terminated: ERROR {rc=2} [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15885)] 21:14:10.764721 run osmo-msc_10.42.42.6(pid=15885): stdout: | (launched: 2022-12-09_21:14:09.661809) 21:14:10.813364 run osmo-msc_10.42.42.6(pid=15885): stderr: | 20221209211409931 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211409931 DLGLOBAL DEBUG validating counter group 0x7f2dab144c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211409931 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211409931 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211409931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211409932 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211409933 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211409934 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211409934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211409934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:14:10.862629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Terminating (SIGTERM) 21:14:10.902152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Terminating (SIGTERM) 21:14:10.941850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminating (SIGTERM) 21:14:10.981927 --- ParallelTerminationStrategy: PID 15878 died... 21:14:11.000738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15878): Terminated: ok {rc=0} 21:14:11.045161 --- ParallelTerminationStrategy: PID 15881 died... 21:14:11.063743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15881): Terminated: ok {rc=0} 21:14:11.107404 --- ParallelTerminationStrategy: PID 15884 died... 21:14:11.128022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15884): Terminated: ok {rc=0} 21:14:11.215077 bus /sierra_9: Setting Powered False 21:14:12.313393 bus /sierra_9: Setting Powered False 21:14:13.428765 bus /sierra_8: Setting Powered False 21:14:14.525066 bus /sierra_8: Setting Powered False 21:14:15.639165 bus /sierra_3: Setting Powered False 21:14:16.734220 bus /sierra_3: Setting Powered False 21:14:17.854148 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900 --------------------------------------------------------------------- 21:14:19.125627 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:14:19.130731 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 21:14:19.162941 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 21:14:19.200762 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 21:14:19.287755 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 21:14:19.321939 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 21:14:19.361168 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 21:14:19.946704 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 21:14:20.000198 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.011475 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:20.060029 tst cs_paging_gprs_active.py: using LAC 23767 21:14:20.188935 tst cs_paging_gprs_active.py: using RAC 52 21:14:20.316784 tst cs_paging_gprs_active.py: using CellId 23767 21:14:20.442645 tst cs_paging_gprs_active.py: using BVCI 23768 21:14:20.559444 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.570627 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.581603 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.592455 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.603278 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.614088 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.625130 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.635889 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:20.646931 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:20.765081 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:20.883205 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:14:21.102215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:21.425693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15890): Launched 21:14:21.705159 run iperf3-srv_10.42.42.10(pid=15891): Launched 21:14:21.825686 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:14:22.043607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:22.367713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15892): Launched 21:14:22.646973 run iperf3-srv_10.42.42.10(pid=15893): Launched 21:14:22.767234 tst cs_paging_gprs_active.py:38: start network... 21:14:22.984514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:23.484924 run create_hlr_db(pid=15894): Launched 21:14:23.615136 bus /sierra_2: Setting Powered False 21:14:24.679000 run create_hlr_db(pid=15894): Terminated: ok {rc=0} 21:14:25.125321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Launched 21:14:25.446721 run osmo-hlr_10.42.42.2(pid=15897): Launched 21:14:25.568716 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:26.120277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Launched 21:14:26.442747 run osmo-stp_10.42.42.5(pid=15900): Launched 21:14:26.564378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:27.118265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15902): Launched 21:14:27.240920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:27.514016 run patchelf(pid=15903): Launched 21:14:27.692809 run osmo-stp_10.42.42.5(pid=15900): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] 21:14:27.829278 run osmo-stp_10.42.42.5(pid=15900): stdout: | (launched: 2022-12-09_21:14:26.384033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:27.967275 run osmo-stp_10.42.42.5(pid=15900): stderr: | 20221209211426572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211426573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211426573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211426573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211426574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211426574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211426574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:28.105165 run osmo-stp_10.42.42.5(pid=15900): stdout: | (launched: 2022-12-09_21:14:26.384033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:28.237173 run osmo-stp_10.42.42.5(pid=15900): stderr: | 20221209211426572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211426573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211426573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211426573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211426574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211426574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211426574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:28.394262 run patchelf(pid=15903): Terminating (SIGINT) 21:14:28.575478 run patchelf(pid=15903): Terminated: ok {rc=0} 21:14:28.705830 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15900): Process ended prematurely: osmo-stp_10.42.42.5(pid=15900) [trial-2364↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] [trial-2364↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 21:14:28.716027 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 21:14:28.744362 run osmo-hlr_10.42.42.2(pid=15897): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15897)] 21:14:28.793758 run osmo-hlr_10.42.42.2(pid=15897): stdout: | (launched: 2022-12-09_21:14:25.388165) 21:14:28.844682 run osmo-hlr_10.42.42.2(pid=15897): stderr: | 20221209211425584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211425584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211425584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211425584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211425584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211425584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211425596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211425606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211425606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211425606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:28.896245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15890): Terminating (SIGTERM) 21:14:28.937569 run iperf3-srv_10.42.42.10(pid=15891): Terminating (SIGTERM) 21:14:28.978706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15892): Terminating (SIGTERM) 21:14:29.019803 run iperf3-srv_10.42.42.10(pid=15893): Terminating (SIGTERM) 21:14:29.060930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Terminating (SIGTERM) 21:14:29.102532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Terminating (SIGTERM) 21:14:29.143697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15902): Terminating (SIGTERM) 21:14:29.185148 --- ParallelTerminationStrategy: PID 15890 died... 21:14:29.204922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15890): Terminated: ok {rc=0} 21:14:29.250620 --- ParallelTerminationStrategy: PID 15891 died... 21:14:29.269748 run iperf3-srv_10.42.42.10(pid=15891): Terminated {rc=256} 21:14:29.315673 --- ParallelTerminationStrategy: PID 15892 died... 21:14:29.335108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15892): Terminated: ok {rc=0} 21:14:29.380849 --- ParallelTerminationStrategy: PID 15893 died... 21:14:29.400538 run iperf3-srv_10.42.42.10(pid=15893): Terminated {rc=256} 21:14:29.445897 --- ParallelTerminationStrategy: PID 15896 died... 21:14:29.465324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15896): Terminated: ok {rc=0} 21:14:29.510682 --- ParallelTerminationStrategy: PID 15899 died... 21:14:29.529912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15899): Terminated: ok {rc=0} 21:14:29.575400 --- ParallelTerminationStrategy: PID 15902 died... 21:14:29.594946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15902): Terminated: ok {rc=0} 21:14:29.680506 bus /gobi_0: Setting Powered False 21:14:30.779493 bus /gobi_0: Setting Powered False 21:14:31.901472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 21:14:33.046029 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.057424 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:33.107643 tst iperf3.py: using LAC 23768 21:14:33.227497 tst iperf3.py: using RAC 53 21:14:33.347162 tst iperf3.py: using CellId 23768 21:14:33.466838 tst iperf3.py: using BVCI 23769 21:14:33.577717 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.588345 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.598983 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.610238 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.620896 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.631593 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.642493 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.652902 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:33.663713 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:33.783638 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:14:34.003430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:34.327907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15904): Launched 21:14:34.609044 run iperf3-srv_10.42.42.10(pid=15905): Launched 21:14:34.730414 tst iperf3.py:8: start network... 21:14:34.948450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:35.449860 run create_hlr_db(pid=15906): Launched 21:14:35.581193 bus /gobi_6: Setting Powered False 21:14:36.644785 run create_hlr_db(pid=15906): Terminated: ok {rc=0} 21:14:37.075907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15908): Launched 21:14:37.378395 run osmo-hlr_10.42.42.2(pid=15909): Launched 21:14:37.494512 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:38.027214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Launched 21:14:38.326560 run osmo-stp_10.42.42.5(pid=15912): Launched 21:14:38.440842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:38.958554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15914): Launched 21:14:39.073087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:39.327196 run patchelf(pid=15915): Launched 21:14:39.493522 run osmo-stp_10.42.42.5(pid=15912): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15912)] 21:14:39.620114 run osmo-stp_10.42.42.5(pid=15912): stdout: | (launched: 2022-12-09_21:14:38.271397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:39.748844 run osmo-stp_10.42.42.5(pid=15912): stderr: | 20221209211438438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211438438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211438439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211438439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211438440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211438440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211438440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:39.877381 run osmo-stp_10.42.42.5(pid=15912): stdout: | (launched: 2022-12-09_21:14:38.271397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:40.000337 run osmo-stp_10.42.42.5(pid=15912): stderr: | 20221209211438438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211438438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211438439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211438439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211438440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211438440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211438440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:40.146700 run patchelf(pid=15915): Terminating (SIGINT) 21:14:40.315249 run patchelf(pid=15915): Terminated: ok {rc=0} 21:14:40.436731 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15912): Process ended prematurely: osmo-stp_10.42.42.5(pid=15912) [trial-2364↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15912)] [trial-2364↪gprs:nanobts+band-900↪iperf3.py:8] 21:14:40.446313 tst iperf3.py:8: Test FAILED (7.4 sec) 21:14:40.474057 run osmo-hlr_10.42.42.2(pid=15909): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15909)] 21:14:40.521830 run osmo-hlr_10.42.42.2(pid=15909): stdout: | (launched: 2022-12-09_21:14:37.322806) 21:14:40.570908 run osmo-hlr_10.42.42.2(pid=15909): stderr: | 20221209211437496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211437496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211437496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211437497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211437497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211437497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211437509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211437517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211437517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211437517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:40.620599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15904): Terminating (SIGTERM) 21:14:40.660450 run iperf3-srv_10.42.42.10(pid=15905): Terminating (SIGTERM) 21:14:40.700077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15908): Terminating (SIGTERM) 21:14:40.739910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Terminating (SIGTERM) 21:14:40.780087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15914): Terminating (SIGTERM) 21:14:40.820751 --- ParallelTerminationStrategy: PID 15904 died... 21:14:40.840313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15904): Terminated: ok {rc=0} 21:14:40.884699 --- ParallelTerminationStrategy: PID 15905 died... 21:14:40.903198 run iperf3-srv_10.42.42.10(pid=15905): Terminated {rc=256} 21:14:40.947216 --- ParallelTerminationStrategy: PID 15908 died... 21:14:40.965827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15908): Terminated: ok {rc=0} 21:14:41.009997 --- ParallelTerminationStrategy: PID 15911 died... 21:14:41.028599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Terminated: ok {rc=0} 21:14:41.073497 --- ParallelTerminationStrategy: PID 15914 died... 21:14:41.092200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15914): Terminated: ok {rc=0} 21:14:41.177510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 21:14:42.322929 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.334356 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:14:42.386821 tst iperf3m4.py: using LAC 23769 21:14:42.506004 tst iperf3m4.py: using RAC 54 21:14:42.621994 tst iperf3m4.py: using CellId 23769 21:14:42.740701 tst iperf3m4.py: using BVCI 23770 21:14:42.850554 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.861327 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.871778 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.882629 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.893224 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.903775 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.914633 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.925566 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:14:42.936231 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:43.053532 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:43.171975 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:43.292128 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:14:43.408527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:14:43.611548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:43.914938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15916): Launched 21:14:44.177156 run iperf3-srv_10.42.42.10(pid=15917): Launched 21:14:44.289560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:14:44.491262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:44.793591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15918): Launched 21:14:45.054479 run iperf3-srv_10.42.42.10(pid=15919): Launched 21:14:45.167315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:14:45.368771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:45.670231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15920): Launched 21:14:45.957660 run iperf3-srv_10.42.42.10(pid=15921): Launched 21:14:46.111683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:14:46.335543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:14:46.676656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15922): Launched 21:14:46.985973 run iperf3-srv_10.42.42.10(pid=15923): Launched 21:14:47.115329 tst iperf3m4.py:8: start network... 21:14:47.334146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:14:47.837240 run create_hlr_db(pid=15924): Launched 21:14:47.967632 bus /gobi_6: Setting Powered False 21:14:49.031406 run create_hlr_db(pid=15924): Terminated: ok {rc=0} 21:14:49.484035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15926): Launched 21:14:49.808289 run osmo-hlr_10.42.42.2(pid=15927): Launched 21:14:49.931339 run osmo-stp_10.42.42.5: Starting osmo-stp 21:14:50.490671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15929): Launched 21:14:50.815693 run osmo-stp_10.42.42.5(pid=15930): Launched 21:14:50.938664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:14:51.501731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15932): Launched 21:14:51.626135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:14:51.902295 run patchelf(pid=15933): Launched 21:14:52.083632 run osmo-stp_10.42.42.5(pid=15930): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15930)] 21:14:52.222276 run osmo-stp_10.42.42.5(pid=15930): stdout: | (launched: 2022-12-09_21:14:50.754652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:52.361983 run osmo-stp_10.42.42.5(pid=15930): stderr: | 20221209211450944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211450945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211450945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211450945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211450946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211450946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211450946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:52.501567 run osmo-stp_10.42.42.5(pid=15930): stdout: | (launched: 2022-12-09_21:14:50.754652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:14:52.635353 run osmo-stp_10.42.42.5(pid=15930): stderr: | 20221209211450944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211450945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211450945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211450945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211450946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211450946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211450946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:14:52.793882 run patchelf(pid=15933): Terminating (SIGINT) 21:14:52.975638 run patchelf(pid=15933): Terminated: ok {rc=0} 21:14:53.106863 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15930): Process ended prematurely: osmo-stp_10.42.42.5(pid=15930) [trial-2364↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15930)] [trial-2364↪gprs:nanobts+band-900↪iperf3m4.py:8] 21:14:53.117093 tst iperf3m4.py:8: Test FAILED (10.8 sec) 21:14:53.146201 run osmo-hlr_10.42.42.2(pid=15927): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15927)] 21:14:53.196680 run osmo-hlr_10.42.42.2(pid=15927): stdout: | (launched: 2022-12-09_21:14:49.747962) 21:14:53.248904 run osmo-hlr_10.42.42.2(pid=15927): stderr: | 20221209211449943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211449943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211449943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211449943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211449943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211449943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211449956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211449965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211449965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211449965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:14:53.301646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15916): Terminating (SIGTERM) 21:14:53.344023 run iperf3-srv_10.42.42.10(pid=15917): Terminating (SIGTERM) 21:14:53.386228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15918): Terminating (SIGTERM) 21:14:53.428061 run iperf3-srv_10.42.42.10(pid=15919): Terminating (SIGTERM) 21:14:53.470076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15920): Terminating (SIGTERM) 21:14:53.512494 run iperf3-srv_10.42.42.10(pid=15921): Terminating (SIGTERM) 21:14:53.554290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15922): Terminating (SIGTERM) 21:14:53.596156 run iperf3-srv_10.42.42.10(pid=15923): Terminating (SIGTERM) 21:14:53.638027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15926): Terminating (SIGTERM) 21:14:53.680035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15929): Terminating (SIGTERM) 21:14:53.722111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15932): Terminating (SIGTERM) 21:14:53.764418 --- ParallelTerminationStrategy: PID 15916 died... 21:14:53.784726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15916): Terminated: ok {rc=0} 21:14:53.831482 --- ParallelTerminationStrategy: PID 15917 died... 21:14:53.851161 run iperf3-srv_10.42.42.10(pid=15917): Terminated {rc=256} 21:14:53.897608 --- ParallelTerminationStrategy: PID 15918 died... 21:14:53.917426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15918): Terminated: ok {rc=0} 21:14:53.963603 --- ParallelTerminationStrategy: PID 15919 died... 21:14:53.983401 run iperf3-srv_10.42.42.10(pid=15919): Terminated {rc=256} 21:14:54.029601 --- ParallelTerminationStrategy: PID 15920 died... 21:14:54.049375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15920): Terminated: ok {rc=0} 21:14:54.095627 --- ParallelTerminationStrategy: PID 15921 died... 21:14:54.115255 run iperf3-srv_10.42.42.10(pid=15921): Terminated {rc=256} 21:14:54.161752 --- ParallelTerminationStrategy: PID 15922 died... 21:14:54.181731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15922): Terminated: ok {rc=0} 21:14:54.228044 --- ParallelTerminationStrategy: PID 15923 died... 21:14:54.247832 run iperf3-srv_10.42.42.10(pid=15923): Terminated {rc=256} 21:14:54.293804 --- ParallelTerminationStrategy: PID 15926 died... 21:14:54.313665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15926): Terminated: ok {rc=0} 21:14:54.360286 --- ParallelTerminationStrategy: PID 15929 died... 21:14:54.380223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15929): Terminated: ok {rc=0} 21:14:54.426483 --- ParallelTerminationStrategy: PID 15932 died... 21:14:54.446319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15932): Terminated: ok {rc=0} 21:14:54.533653 bus /gobi_4: Setting Powered False 21:14:55.633657 bus /gobi_4: Setting Powered False 21:14:56.750367 bus /gobi_1: Setting Powered False 21:14:57.850057 bus /gobi_1: Setting Powered False 21:14:58.965665 bus /gobi_0: Setting Powered False 21:15:00.063981 bus /gobi_0: Setting Powered False 21:15:01.179722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900 ping.py ---------------------------------------------- 21:15:02.288718 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.301071 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:15:02.359037 tst ping.py: using LAC 23770 21:15:02.486370 tst ping.py: using RAC 55 21:15:02.610661 tst ping.py: using CellId 23770 21:15:02.734926 tst ping.py: using BVCI 23771 21:15:02.850952 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.862319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.873576 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.884661 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.895567 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.906412 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.917471 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:02.928397 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:15:03.049818 tst ping.py:19: start network... 21:15:03.264210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:03.758415 run create_hlr_db(pid=15944): Launched 21:15:03.887686 bus /gobi_6: Setting Powered False 21:15:04.951604 run create_hlr_db(pid=15944): Terminated: ok {rc=0} 21:15:05.396810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Launched 21:15:05.715115 run osmo-hlr_10.42.42.2(pid=15947): Launched 21:15:05.836408 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:06.389127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Launched 21:15:06.707545 run osmo-stp_10.42.42.5(pid=15950): Launched 21:15:06.829220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:07.381160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15952): Launched 21:15:07.502594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:07.771635 run patchelf(pid=15953): Launched 21:15:07.948936 run osmo-stp_10.42.42.5(pid=15950): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] 21:15:08.084067 run osmo-stp_10.42.42.5(pid=15950): stdout: | (launched: 2022-12-09_21:15:06.648669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:08.221018 run osmo-stp_10.42.42.5(pid=15950): stderr: | 20221209211506839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211506840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211506840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211506840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211506841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211506841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211506841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:08.359157 run osmo-stp_10.42.42.5(pid=15950): stdout: | (launched: 2022-12-09_21:15:06.648669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:08.490300 run osmo-stp_10.42.42.5(pid=15950): stderr: | 20221209211506839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211506840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211506840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211506840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211506841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211506841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211506841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:08.645561 run patchelf(pid=15953): Terminating (SIGINT) 21:15:08.824303 run patchelf(pid=15953): Terminated: ok {rc=0} 21:15:08.953301 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15950): Process ended prematurely: osmo-stp_10.42.42.5(pid=15950) [trial-2364↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] [trial-2364↪gprs:nanobts+band-900↪ping.py:22] 21:15:08.962691 tst ping.py:22: Test FAILED (6.7 sec) 21:15:08.990855 run osmo-hlr_10.42.42.2(pid=15947): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15947)] 21:15:09.040869 run osmo-hlr_10.42.42.2(pid=15947): stdout: | (launched: 2022-12-09_21:15:05.656334) 21:15:09.092686 run osmo-hlr_10.42.42.2(pid=15947): stderr: | 20221209211505853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211505853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211505853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211505853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211505853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211505853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211505866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211505874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211505874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211505874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:09.144716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Terminating (SIGTERM) 21:15:09.186597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Terminating (SIGTERM) 21:15:09.228287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15952): Terminating (SIGTERM) 21:15:09.270265 --- ParallelTerminationStrategy: PID 15946 died... 21:15:09.290355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15946): Terminated: ok {rc=0} 21:15:09.337210 --- ParallelTerminationStrategy: PID 15949 died... 21:15:09.357296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15949): Terminated: ok {rc=0} 21:15:09.403745 --- ParallelTerminationStrategy: PID 15952 died... 21:15:09.423428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15952): Terminated: ok {rc=0} 21:15:09.511499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 21:15:10.598751 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:10.611188 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 21:15:10.662063 tst ping_idle_ping.py: using LAC 23771 21:15:10.793132 tst ping_idle_ping.py: using RAC 56 21:15:10.910008 tst ping_idle_ping.py: using CellId 23771 21:15:11.026603 tst ping_idle_ping.py: using BVCI 23772 21:15:11.137770 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.148294 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.158910 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.169665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.180302 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.190979 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.201728 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 21:15:11.212405 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 21:15:11.334084 tst ping_idle_ping.py:24: start network... 21:15:11.550097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:12.049665 run create_hlr_db(pid=15954): Launched 21:15:12.179797 bus /gobi_6: Setting Powered False 21:15:13.242870 run create_hlr_db(pid=15954): Terminated: ok {rc=0} 21:15:13.701503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16134): Launched 21:15:14.039588 run osmo-hlr_10.42.42.2(pid=16176): Launched 21:15:14.189493 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:14.821740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16310): Launched 21:15:15.121527 run osmo-stp_10.42.42.5(pid=16311): Launched 21:15:15.235107 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:15.753596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16313): Launched 21:15:15.882098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:16.161688 run patchelf(pid=16314): Launched 21:15:16.355272 run osmo-stp_10.42.42.5(pid=16311): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16311)] 21:15:16.496063 run osmo-stp_10.42.42.5(pid=16311): stdout: | (launched: 2022-12-09_21:15:15.065747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:16.636226 run osmo-stp_10.42.42.5(pid=16311): stderr: | 20221209211515237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211515237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211515237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211515238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211515238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211515238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211515238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:16.779230 run osmo-stp_10.42.42.5(pid=16311): stdout: | (launched: 2022-12-09_21:15:15.065747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:16.915327 run osmo-stp_10.42.42.5(pid=16311): stderr: | 20221209211515237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211515237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211515237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211515238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211515238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211515238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211515238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:17.075180 run patchelf(pid=16314): Terminating (SIGINT) 21:15:17.259207 run patchelf(pid=16314): Terminated: ok {rc=0} 21:15:17.389422 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16311): Process ended prematurely: osmo-stp_10.42.42.5(pid=16311) [trial-2364↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16311)] [trial-2364↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 21:15:17.399423 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 21:15:17.428238 run osmo-hlr_10.42.42.2(pid=16176): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16176)] 21:15:17.479387 run osmo-hlr_10.42.42.2(pid=16176): stdout: | (launched: 2022-12-09_21:15:13.975330) 21:15:17.531970 run osmo-hlr_10.42.42.2(pid=16176): stderr: | 20221209211514296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211514296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211514296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211514296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211514296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211514296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211514312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211514329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211514330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211514330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:17.585214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16134): Terminating (SIGTERM) 21:15:17.627471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16310): Terminating (SIGTERM) 21:15:17.669861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16313): Terminating (SIGTERM) 21:15:17.712823 --- ParallelTerminationStrategy: PID 16134 died... 21:15:17.732920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16134): Terminated: ok {rc=0} 21:15:17.780324 --- ParallelTerminationStrategy: PID 16310 died... 21:15:17.800282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16310): Terminated: ok {rc=0} 21:15:17.847135 --- ParallelTerminationStrategy: PID 16313 died... 21:15:17.867181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16313): Terminated: ok {rc=0} 21:15:17.955688 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 21:15:19.263866 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:15:19.271988 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 21:15:19.305455 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 21:15:19.345318 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 21:15:19.432480 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 21:15:19.465725 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 21:15:19.505133 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 21:15:20.107182 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 21:15:20.159781 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.171221 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:20.219840 tst cs_paging_gprs_active.py: using LAC 23772 21:15:20.346367 tst cs_paging_gprs_active.py: using RAC 57 21:15:20.473052 tst cs_paging_gprs_active.py: using CellId 23772 21:15:20.598576 tst cs_paging_gprs_active.py: using BVCI 23773 21:15:20.716496 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.727889 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.739120 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.750415 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.761482 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.772675 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.784152 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.795300 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:20.806895 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:20.924688 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:21.046189 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:15:21.268120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:21.596526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16318): Launched 21:15:21.879562 run iperf3-srv_10.42.42.10(pid=16319): Launched 21:15:22.001825 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:15:22.221693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:22.550504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16320): Launched 21:15:22.837866 run iperf3-srv_10.42.42.10(pid=16321): Launched 21:15:22.955216 tst cs_paging_gprs_active.py:38: start network... 21:15:23.170937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:23.664204 run create_hlr_db(pid=16427): Launched 21:15:23.806054 bus /gobi_6: Setting Powered False 21:15:24.868001 run create_hlr_db(pid=16427): Terminated: ok {rc=0} 21:15:25.316599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Launched 21:15:25.644222 run osmo-hlr_10.42.42.2(pid=16500): Launched 21:15:25.891985 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:26.598959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Launched 21:15:26.931289 run osmo-stp_10.42.42.5(pid=16503): Launched 21:15:27.177881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:27.857850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16505): Launched 21:15:27.992773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:28.264431 run patchelf(pid=16506): Launched 21:15:28.457471 run osmo-stp_10.42.42.5(pid=16503): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] 21:15:28.597397 run osmo-stp_10.42.42.5(pid=16503): stdout: | (launched: 2022-12-09_21:15:26.872458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:28.734657 run osmo-stp_10.42.42.5(pid=16503): stderr: | 20221209211527197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211527197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211527197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211527198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211527198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211527198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211527198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:28.866618 run osmo-stp_10.42.42.5(pid=16503): stdout: | (launched: 2022-12-09_21:15:26.872458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:28.992267 run osmo-stp_10.42.42.5(pid=16503): stderr: | 20221209211527197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211527197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211527197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211527198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211527198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211527198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211527198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:29.141712 run patchelf(pid=16506): Terminating (SIGINT) 21:15:29.313995 run patchelf(pid=16506): Terminated: ok {rc=0} 21:15:29.437968 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16503): Process ended prematurely: osmo-stp_10.42.42.5(pid=16503) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 21:15:29.447767 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 21:15:29.475680 run osmo-hlr_10.42.42.2(pid=16500): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16500)] 21:15:29.523711 run osmo-hlr_10.42.42.2(pid=16500): stdout: | (launched: 2022-12-09_21:15:25.586046) 21:15:29.573232 run osmo-hlr_10.42.42.2(pid=16500): stderr: | 20221209211525923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211525923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211525923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211525924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211525924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211525924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211525945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211525961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211525961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211525961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:29.623307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16318): Terminating (SIGTERM) 21:15:29.663186 run iperf3-srv_10.42.42.10(pid=16319): Terminating (SIGTERM) 21:15:29.703755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16320): Terminating (SIGTERM) 21:15:29.747595 run iperf3-srv_10.42.42.10(pid=16321): Terminating (SIGTERM) 21:15:29.788875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Terminating (SIGTERM) 21:15:29.830936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Terminating (SIGTERM) 21:15:29.872498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16505): Terminating (SIGTERM) 21:15:29.913953 --- ParallelTerminationStrategy: PID 16318 died... 21:15:29.933865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16318): Terminated: ok {rc=0} 21:15:29.979687 --- ParallelTerminationStrategy: PID 16319 died... 21:15:29.999068 run iperf3-srv_10.42.42.10(pid=16319): Terminated {rc=256} 21:15:30.044749 --- ParallelTerminationStrategy: PID 16320 died... 21:15:30.064343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16320): Terminated: ok {rc=0} 21:15:30.110518 --- ParallelTerminationStrategy: PID 16321 died... 21:15:30.130159 run iperf3-srv_10.42.42.10(pid=16321): Terminated {rc=256} 21:15:30.175986 --- ParallelTerminationStrategy: PID 16499 died... 21:15:30.195542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16499): Terminated: ok {rc=0} 21:15:30.241411 --- ParallelTerminationStrategy: PID 16502 died... 21:15:30.260703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16502): Terminated: ok {rc=0} 21:15:30.306790 --- ParallelTerminationStrategy: PID 16505 died... 21:15:30.326266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16505): Terminated: ok {rc=0} 21:15:30.414385 bus /gobi_0: Setting Powered False 21:15:31.515578 bus /gobi_0: Setting Powered False 21:15:32.641710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 21:15:33.786119 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:33.797764 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:33.851983 tst iperf3.py: using LAC 23773 21:15:33.972407 tst iperf3.py: using RAC 58 21:15:34.090382 tst iperf3.py: using CellId 23773 21:15:34.210682 tst iperf3.py: using BVCI 23774 21:15:34.323521 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.334465 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.345774 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.356788 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.367836 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.378926 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.389969 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.400934 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:34.412180 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:34.532349 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:15:34.756020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:35.086461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16509): Launched 21:15:35.373589 run iperf3-srv_10.42.42.10(pid=16510): Launched 21:15:35.496456 tst iperf3.py:8: start network... 21:15:35.718708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:36.227528 run create_hlr_db(pid=16511): Launched 21:15:36.362638 bus /gobi_6: Setting Powered False 21:15:37.427718 run create_hlr_db(pid=16511): Terminated: ok {rc=0} 21:15:37.865628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Launched 21:15:38.173253 run osmo-hlr_10.42.42.2(pid=16514): Launched 21:15:38.290119 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:38.835745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Launched 21:15:39.144270 run osmo-stp_10.42.42.5(pid=16517): Launched 21:15:39.261205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:39.791026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16519): Launched 21:15:39.909364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:40.170072 run patchelf(pid=16520): Launched 21:15:40.342454 run osmo-stp_10.42.42.5(pid=16517): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] 21:15:40.471572 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-09_21:15:39.087209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:40.602420 run osmo-stp_10.42.42.5(pid=16517): stderr: | 20221209211539260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211539261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211539261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211539261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211539262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211539262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211539262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:40.732343 run osmo-stp_10.42.42.5(pid=16517): stdout: | (launched: 2022-12-09_21:15:39.087209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:40.857218 run osmo-stp_10.42.42.5(pid=16517): stderr: | 20221209211539260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211539261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211539261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211539261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211539262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211539262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211539262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:41.005660 run patchelf(pid=16520): Terminating (SIGINT) 21:15:41.177983 run patchelf(pid=16520): Terminated: ok {rc=0} 21:15:41.302153 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 21:15:41.311751 tst iperf3.py:8: Test FAILED (7.6 sec) 21:15:41.339217 run osmo-hlr_10.42.42.2(pid=16514): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16514)] 21:15:41.387018 run osmo-hlr_10.42.42.2(pid=16514): stdout: | (launched: 2022-12-09_21:15:38.116260) 21:15:41.436059 run osmo-hlr_10.42.42.2(pid=16514): stderr: | 20221209211538293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211538293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211538293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211538293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211538293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211538293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211538306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211538315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211538315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211538315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:41.485524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16509): Terminating (SIGTERM) 21:15:41.525095 run iperf3-srv_10.42.42.10(pid=16510): Terminating (SIGTERM) 21:15:41.564868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminating (SIGTERM) 21:15:41.604356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminating (SIGTERM) 21:15:41.643638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16519): Terminating (SIGTERM) 21:15:41.683302 --- ParallelTerminationStrategy: PID 16509 died... 21:15:41.702184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16509): Terminated: ok {rc=0} 21:15:41.746239 --- ParallelTerminationStrategy: PID 16510 died... 21:15:41.764667 run iperf3-srv_10.42.42.10(pid=16510): Terminated {rc=256} 21:15:41.809099 --- ParallelTerminationStrategy: PID 16513 died... 21:15:41.827815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16513): Terminated: ok {rc=0} 21:15:41.871852 --- ParallelTerminationStrategy: PID 16516 died... 21:15:41.890693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16516): Terminated: ok {rc=0} 21:15:41.934928 --- ParallelTerminationStrategy: PID 16519 died... 21:15:41.953736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16519): Terminated: ok {rc=0} 21:15:42.037628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 21:15:43.180629 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.192288 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:15:43.241772 tst iperf3m4.py: using LAC 23774 21:15:43.373273 tst iperf3m4.py: using RAC 59 21:15:43.501499 tst iperf3m4.py: using CellId 23774 21:15:43.631967 tst iperf3m4.py: using BVCI 23775 21:15:43.751202 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.762661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.774055 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.785523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.796738 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.808020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.819337 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.830420 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:15:43.841830 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:43.962685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:44.081929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:44.202504 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:15:44.326060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:15:44.549007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:44.879264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16521): Launched 21:15:45.164778 run iperf3-srv_10.42.42.10(pid=16522): Launched 21:15:45.289038 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:15:45.510956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:45.844490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16523): Launched 21:15:46.138542 run iperf3-srv_10.42.42.10(pid=16524): Launched 21:15:46.276347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:15:46.502985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:46.842782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Launched 21:15:47.141714 run iperf3-srv_10.42.42.10(pid=16526): Launched 21:15:47.274533 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:15:47.497866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:15:47.828226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Launched 21:15:48.115236 run iperf3-srv_10.42.42.10(pid=16528): Launched 21:15:48.239563 tst iperf3m4.py:8: start network... 21:15:48.461733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:15:48.972714 run create_hlr_db(pid=16529): Launched 21:15:49.107816 bus /gobi_6: Setting Powered False 21:15:50.172499 run create_hlr_db(pid=16529): Terminated: ok {rc=0} 21:15:50.631569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Launched 21:15:50.962671 run osmo-hlr_10.42.42.2(pid=16532): Launched 21:15:51.090022 run osmo-stp_10.42.42.5: Starting osmo-stp 21:15:51.659179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Launched 21:15:51.989674 run osmo-stp_10.42.42.5(pid=16535): Launched 21:15:52.115418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:15:52.684782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Launched 21:15:52.811095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:15:53.088355 run patchelf(pid=16538): Launched 21:15:53.271825 run osmo-stp_10.42.42.5(pid=16535): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] 21:15:53.411187 run osmo-stp_10.42.42.5(pid=16535): stdout: | (launched: 2022-12-09_21:15:51.928785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:53.551369 run osmo-stp_10.42.42.5(pid=16535): stderr: | 20221209211552122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211552122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211552123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211552123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211552124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211552124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211552124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:53.691591 run osmo-stp_10.42.42.5(pid=16535): stdout: | (launched: 2022-12-09_21:15:51.928785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:15:53.826204 run osmo-stp_10.42.42.5(pid=16535): stderr: | 20221209211552122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211552122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211552123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211552123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211552124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211552124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211552124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:15:53.985235 run patchelf(pid=16538): Terminating (SIGINT) 21:15:54.168616 run patchelf(pid=16538): Terminated: ok {rc=0} 21:15:54.301096 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16535): Process ended prematurely: osmo-stp_10.42.42.5(pid=16535) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 21:15:54.311391 tst iperf3m4.py:8: Test FAILED (11.2 sec) 21:15:54.340251 run osmo-hlr_10.42.42.2(pid=16532): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16532)] 21:15:54.390554 run osmo-hlr_10.42.42.2(pid=16532): stdout: | (launched: 2022-12-09_21:15:50.901680) 21:15:54.442064 run osmo-hlr_10.42.42.2(pid=16532): stderr: | 20221209211551102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211551102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211551102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211551102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211551102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211551103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211551115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211551123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211551124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211551124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:15:54.493861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16521): Terminating (SIGTERM) 21:15:54.535324 run iperf3-srv_10.42.42.10(pid=16522): Terminating (SIGTERM) 21:15:54.576529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16523): Terminating (SIGTERM) 21:15:54.618089 run iperf3-srv_10.42.42.10(pid=16524): Terminating (SIGTERM) 21:15:54.659953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Terminating (SIGTERM) 21:15:54.701391 run iperf3-srv_10.42.42.10(pid=16526): Terminating (SIGTERM) 21:15:54.742644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Terminating (SIGTERM) 21:15:54.783956 run iperf3-srv_10.42.42.10(pid=16528): Terminating (SIGTERM) 21:15:54.825048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Terminating (SIGTERM) 21:15:54.866425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Terminating (SIGTERM) 21:15:54.907680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Terminating (SIGTERM) 21:15:54.949465 --- ParallelTerminationStrategy: PID 16521 died... 21:15:54.969538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16521): Terminated: ok {rc=0} 21:15:55.015692 --- ParallelTerminationStrategy: PID 16522 died... 21:15:55.035041 run iperf3-srv_10.42.42.10(pid=16522): Terminated {rc=256} 21:15:55.081121 --- ParallelTerminationStrategy: PID 16523 died... 21:15:55.100562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16523): Terminated: ok {rc=0} 21:15:55.146514 --- ParallelTerminationStrategy: PID 16524 died... 21:15:55.166061 run iperf3-srv_10.42.42.10(pid=16524): Terminated {rc=256} 21:15:55.211972 --- ParallelTerminationStrategy: PID 16525 died... 21:15:55.231563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16525): Terminated: ok {rc=0} 21:15:55.277298 --- ParallelTerminationStrategy: PID 16526 died... 21:15:55.296615 run iperf3-srv_10.42.42.10(pid=16526): Terminated {rc=256} 21:15:55.342866 --- ParallelTerminationStrategy: PID 16527 died... 21:15:55.362712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16527): Terminated: ok {rc=0} 21:15:55.408762 --- ParallelTerminationStrategy: PID 16528 died... 21:15:55.428272 run iperf3-srv_10.42.42.10(pid=16528): Terminated {rc=256} 21:15:55.473988 --- ParallelTerminationStrategy: PID 16531 died... 21:15:55.493499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16531): Terminated: ok {rc=0} 21:15:55.539500 --- ParallelTerminationStrategy: PID 16534 died... 21:15:55.559059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16534): Terminated: ok {rc=0} 21:15:55.604702 --- ParallelTerminationStrategy: PID 16537 died... 21:15:55.624413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16537): Terminated: ok {rc=0} 21:15:55.710806 bus /gobi_4: Setting Powered False 21:15:56.808191 bus /gobi_4: Setting Powered False 21:15:57.923413 bus /gobi_1: Setting Powered False 21:15:59.020520 bus /gobi_1: Setting Powered False 21:16:00.132310 bus /gobi_0: Setting Powered False 21:16:01.229852 bus /gobi_0: Setting Powered False 21:16:02.349648 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 21:16:03.452219 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:03.463972 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:16:03.515067 tst ping.py: using LAC 23775 21:16:03.633158 tst ping.py: using RAC 60 21:16:03.749841 tst ping.py: using CellId 23775 21:16:03.867469 tst ping.py: using BVCI 23776 21:16:03.976642 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:03.987705 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:03.998530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:04.009680 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:04.020863 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:04.031835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:04.042997 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:04.054034 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:16:04.167510 tst ping.py:19: start network... 21:16:04.368400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:04.834725 run create_hlr_db(pid=16539): Launched 21:16:04.949594 bus /gobi_6: Setting Powered False 21:16:06.009812 run create_hlr_db(pid=16539): Terminated: ok {rc=0} 21:16:06.430532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16541): Launched 21:16:06.731709 run osmo-hlr_10.42.42.2(pid=16542): Launched 21:16:06.847752 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:07.389142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16544): Launched 21:16:07.691197 run osmo-stp_10.42.42.5(pid=16545): Launched 21:16:07.806363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:08.327429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16547): Launched 21:16:08.442171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:08.696882 run patchelf(pid=16548): Launched 21:16:08.866097 run osmo-stp_10.42.42.5(pid=16545): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16545)] 21:16:08.993480 run osmo-stp_10.42.42.5(pid=16545): stdout: | (launched: 2022-12-09_21:16:07.634854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:09.122132 run osmo-stp_10.42.42.5(pid=16545): stderr: | 20221209211607807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211607807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211607807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211607807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211607808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211607808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211607808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:09.251312 run osmo-stp_10.42.42.5(pid=16545): stdout: | (launched: 2022-12-09_21:16:07.634854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:09.374433 run osmo-stp_10.42.42.5(pid=16545): stderr: | 20221209211607807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211607807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211607807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211607807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211607808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211607808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211607808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:09.520305 run patchelf(pid=16548): Terminating (SIGINT) 21:16:09.688622 run patchelf(pid=16548): Terminated: ok {rc=0} 21:16:09.810092 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16545): Process ended prematurely: osmo-stp_10.42.42.5(pid=16545) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16545)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 21:16:09.819042 tst ping.py:22: Test FAILED (6.4 sec) 21:16:09.846450 run osmo-hlr_10.42.42.2(pid=16542): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16542)] 21:16:09.893990 run osmo-hlr_10.42.42.2(pid=16542): stdout: | (launched: 2022-12-09_21:16:06.675618) 21:16:09.943174 run osmo-hlr_10.42.42.2(pid=16542): stderr: | 20221209211606850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211606850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211606850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211606850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211606850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211606850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211606864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211606873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211606873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211606873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:09.992466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16541): Terminating (SIGTERM) 21:16:10.031806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16544): Terminating (SIGTERM) 21:16:10.071195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16547): Terminating (SIGTERM) 21:16:10.110954 --- ParallelTerminationStrategy: PID 16541 died... 21:16:10.129986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16541): Terminated: ok {rc=0} 21:16:10.174078 --- ParallelTerminationStrategy: PID 16544 died... 21:16:10.192169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16544): Terminated: ok {rc=0} 21:16:10.236064 --- ParallelTerminationStrategy: PID 16547 died... 21:16:10.254647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16547): Terminated: ok {rc=0} 21:16:10.337595 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 21:16:11.421301 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:11.432929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 21:16:11.485882 tst ping_idle_ping.py: using LAC 23776 21:16:11.604146 tst ping_idle_ping.py: using RAC 61 21:16:11.720703 tst ping_idle_ping.py: using CellId 23776 21:16:11.837816 tst ping_idle_ping.py: using BVCI 23777 21:16:11.950388 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:11.961717 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:11.972556 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:11.983808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:11.994913 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:12.006089 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:12.017179 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 21:16:12.028353 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 21:16:12.146464 tst ping_idle_ping.py:24: start network... 21:16:12.348636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:12.822566 run create_hlr_db(pid=16549): Launched 21:16:12.939410 bus /gobi_6: Setting Powered False 21:16:13.999457 run create_hlr_db(pid=16549): Terminated: ok {rc=0} 21:16:14.423391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16551): Launched 21:16:14.727358 run osmo-hlr_10.42.42.2(pid=16552): Launched 21:16:14.842977 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:15.367464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16554): Launched 21:16:15.672380 run osmo-stp_10.42.42.5(pid=16555): Launched 21:16:15.788335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:16.398767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16557): Launched 21:16:16.536848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:16.825811 run patchelf(pid=16558): Launched 21:16:16.999435 run osmo-stp_10.42.42.5(pid=16555): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16555)] 21:16:17.130161 run osmo-stp_10.42.42.5(pid=16555): stdout: | (launched: 2022-12-09_21:16:15.615770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:17.262593 run osmo-stp_10.42.42.5(pid=16555): stderr: | 20221209211615787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211615788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211615788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211615788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211615789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211615789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211615789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:17.393166 run osmo-stp_10.42.42.5(pid=16555): stdout: | (launched: 2022-12-09_21:16:15.615770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:17.517583 run osmo-stp_10.42.42.5(pid=16555): stderr: | 20221209211615787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211615788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211615788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211615788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211615789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211615789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211615789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:17.664208 run patchelf(pid=16558): Terminating (SIGINT) 21:16:17.833988 run patchelf(pid=16558): Terminated: ok {rc=0} 21:16:17.956814 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16555): Process ended prematurely: osmo-stp_10.42.42.5(pid=16555) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16555)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 21:16:17.966349 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 21:16:17.994325 run osmo-hlr_10.42.42.2(pid=16552): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16552)] 21:16:18.042131 run osmo-hlr_10.42.42.2(pid=16552): stdout: | (launched: 2022-12-09_21:16:14.670319) 21:16:18.091578 run osmo-hlr_10.42.42.2(pid=16552): stderr: | 20221209211614846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211614846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211614846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211614846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211614846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211614846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211614858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211614867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211614867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211614867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:18.141448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16551): Terminating (SIGTERM) 21:16:18.181425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16554): Terminating (SIGTERM) 21:16:18.221325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16557): Terminating (SIGTERM) 21:16:18.262124 --- ParallelTerminationStrategy: PID 16551 died... 21:16:18.281252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16551): Terminated: ok {rc=0} 21:16:18.326440 --- ParallelTerminationStrategy: PID 16554 died... 21:16:18.345259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16554): Terminated: ok {rc=0} 21:16:18.389520 --- ParallelTerminationStrategy: PID 16557 died... 21:16:18.408076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16557): Terminated: ok {rc=0} 21:16:18.494605 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 21:16:19.796864 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:16:19.803791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 21:16:19.836529 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 21:16:19.874775 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 21:16:19.961445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 21:16:19.994763 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 21:16:20.034451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 21:16:20.631253 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 21:16:20.683959 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:20.695552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:20.763782 tst cs_paging_gprs_active.py: using LAC 23777 21:16:20.892548 tst cs_paging_gprs_active.py: using RAC 62 21:16:21.021393 tst cs_paging_gprs_active.py: using CellId 23777 21:16:21.149817 tst cs_paging_gprs_active.py: using BVCI 23778 21:16:21.268234 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.279893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.291123 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.302565 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.313899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.325453 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.336815 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.348130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:21.360007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:21.476255 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:21.596678 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:16:21.819362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:22.149231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16563): Launched 21:16:22.437186 run iperf3-srv_10.42.42.10(pid=16564): Launched 21:16:22.561514 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:16:22.783089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:23.114163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16565): Launched 21:16:23.400029 run iperf3-srv_10.42.42.10(pid=16566): Launched 21:16:23.524405 tst cs_paging_gprs_active.py:38: start network... 21:16:23.746050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:24.255203 run create_hlr_db(pid=16567): Launched 21:16:24.389466 bus /gobi_6: Setting Powered False 21:16:25.455128 run create_hlr_db(pid=16567): Terminated: ok {rc=0} 21:16:25.893677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16569): Launched 21:16:26.201755 run osmo-hlr_10.42.42.2(pid=16570): Launched 21:16:26.318199 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:26.862437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16572): Launched 21:16:27.171113 run osmo-stp_10.42.42.5(pid=16573): Launched 21:16:27.287909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:27.817577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16575): Launched 21:16:27.934916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:28.195841 run patchelf(pid=16576): Launched 21:16:28.368366 run osmo-stp_10.42.42.5(pid=16573): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16573)] 21:16:28.498754 run osmo-stp_10.42.42.5(pid=16573): stdout: | (launched: 2022-12-09_21:16:27.114007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:28.629893 run osmo-stp_10.42.42.5(pid=16573): stderr: | 20221209211627286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211627286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211627287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211627287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211627287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211627288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211627288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:28.761178 run osmo-stp_10.42.42.5(pid=16573): stdout: | (launched: 2022-12-09_21:16:27.114007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:28.886695 run osmo-stp_10.42.42.5(pid=16573): stderr: | 20221209211627286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211627286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211627287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211627287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211627287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211627288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211627288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:29.036066 run patchelf(pid=16576): Terminating (SIGINT) 21:16:29.209347 run patchelf(pid=16576): Terminated: ok {rc=0} 21:16:29.333864 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16573): Process ended prematurely: osmo-stp_10.42.42.5(pid=16573) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16573)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 21:16:29.343463 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 21:16:29.371839 run osmo-hlr_10.42.42.2(pid=16570): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16570)] 21:16:29.419645 run osmo-hlr_10.42.42.2(pid=16570): stdout: | (launched: 2022-12-09_21:16:26.144378) 21:16:29.469218 run osmo-hlr_10.42.42.2(pid=16570): stderr: | 20221209211626324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211626324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211626324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211626324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211626324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211626324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211626336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211626344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211626345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211626345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:29.519347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16563): Terminating (SIGTERM) 21:16:29.559223 run iperf3-srv_10.42.42.10(pid=16564): Terminating (SIGTERM) 21:16:29.598872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16565): Terminating (SIGTERM) 21:16:29.638592 run iperf3-srv_10.42.42.10(pid=16566): Terminating (SIGTERM) 21:16:29.678108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16569): Terminating (SIGTERM) 21:16:29.717726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16572): Terminating (SIGTERM) 21:16:29.757356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16575): Terminating (SIGTERM) 21:16:29.797776 --- ParallelTerminationStrategy: PID 16563 died... 21:16:29.816928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16563): Terminated: ok {rc=0} 21:16:29.861366 --- ParallelTerminationStrategy: PID 16564 died... 21:16:29.879922 run iperf3-srv_10.42.42.10(pid=16564): Terminated {rc=256} 21:16:29.924155 --- ParallelTerminationStrategy: PID 16565 died... 21:16:29.942688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16565): Terminated: ok {rc=0} 21:16:29.986455 --- ParallelTerminationStrategy: PID 16566 died... 21:16:30.004869 run iperf3-srv_10.42.42.10(pid=16566): Terminated {rc=256} 21:16:30.048737 --- ParallelTerminationStrategy: PID 16569 died... 21:16:30.067244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16569): Terminated: ok {rc=0} 21:16:30.111141 --- ParallelTerminationStrategy: PID 16572 died... 21:16:30.129812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16572): Terminated: ok {rc=0} 21:16:30.173736 --- ParallelTerminationStrategy: PID 16575 died... 21:16:30.192248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16575): Terminated: ok {rc=0} 21:16:30.278039 bus /gobi_0: Setting Powered False 21:16:31.376491 bus /gobi_0: Setting Powered False 21:16:32.490453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 21:16:33.640770 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:33.652896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:33.725511 tst iperf3.py: using LAC 23778 21:16:33.855751 tst iperf3.py: using RAC 63 21:16:33.989120 tst iperf3.py: using CellId 23778 21:16:34.118278 tst iperf3.py: using BVCI 23779 21:16:34.239752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.251227 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.262530 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.273838 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.285030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.296301 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.307734 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.318963 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:34.330352 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:34.448367 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:16:34.656803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:34.965997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16577): Launched 21:16:35.233544 run iperf3-srv_10.42.42.10(pid=16578): Launched 21:16:35.348571 tst iperf3.py:8: start network... 21:16:35.555336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:36.034549 run create_hlr_db(pid=16579): Launched 21:16:36.154482 bus /gobi_6: Setting Powered False 21:16:37.215925 run create_hlr_db(pid=16579): Terminated: ok {rc=0} 21:16:37.665738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Launched 21:16:37.995507 run osmo-hlr_10.42.42.2(pid=16582): Launched 21:16:38.120704 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:38.692073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Launched 21:16:39.022837 run osmo-stp_10.42.42.5(pid=16585): Launched 21:16:39.149169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:39.717203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Launched 21:16:39.844074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:40.123408 run patchelf(pid=16588): Launched 21:16:40.307138 run osmo-stp_10.42.42.5(pid=16585): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] 21:16:40.446436 run osmo-stp_10.42.42.5(pid=16585): stdout: | (launched: 2022-12-09_21:16:38.961660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:40.586985 run osmo-stp_10.42.42.5(pid=16585): stderr: | 20221209211639158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211639158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211639158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211639159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211639159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211639159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211639159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:40.727467 run osmo-stp_10.42.42.5(pid=16585): stdout: | (launched: 2022-12-09_21:16:38.961660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:40.861805 run osmo-stp_10.42.42.5(pid=16585): stderr: | 20221209211639158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211639158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211639158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211639159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211639159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211639159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211639159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:41.021224 run patchelf(pid=16588): Terminating (SIGINT) 21:16:41.204837 run patchelf(pid=16588): Terminated: ok {rc=0} 21:16:41.337756 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16585): Process ended prematurely: osmo-stp_10.42.42.5(pid=16585) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 21:16:41.348113 tst iperf3.py:8: Test FAILED (7.7 sec) 21:16:41.377154 run osmo-hlr_10.42.42.2(pid=16582): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16582)] 21:16:41.427157 run osmo-hlr_10.42.42.2(pid=16582): stdout: | (launched: 2022-12-09_21:16:37.934761) 21:16:41.478646 run osmo-hlr_10.42.42.2(pid=16582): stderr: | 20221209211638136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211638136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211638137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211638137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211638137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211638137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211638150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211638158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211638158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211638158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:41.530615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16577): Terminating (SIGTERM) 21:16:41.572265 run iperf3-srv_10.42.42.10(pid=16578): Terminating (SIGTERM) 21:16:41.613951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Terminating (SIGTERM) 21:16:41.655969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Terminating (SIGTERM) 21:16:41.697820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Terminating (SIGTERM) 21:16:41.739936 --- ParallelTerminationStrategy: PID 16577 died... 21:16:41.760081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16577): Terminated: ok {rc=0} 21:16:41.806835 --- ParallelTerminationStrategy: PID 16578 died... 21:16:41.826359 run iperf3-srv_10.42.42.10(pid=16578): Terminated {rc=256} 21:16:41.872148 --- ParallelTerminationStrategy: PID 16581 died... 21:16:41.891865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16581): Terminated: ok {rc=0} 21:16:41.937795 --- ParallelTerminationStrategy: PID 16584 died... 21:16:41.957556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16584): Terminated: ok {rc=0} 21:16:42.003482 --- ParallelTerminationStrategy: PID 16587 died... 21:16:42.023212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16587): Terminated: ok {rc=0} 21:16:42.109624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 21:16:43.257239 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.268811 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:16:43.336759 tst iperf3m4.py: using LAC 23779 21:16:43.458047 tst iperf3m4.py: using RAC 64 21:16:43.580465 tst iperf3m4.py: using CellId 23779 21:16:43.713401 tst iperf3m4.py: using BVCI 23780 21:16:43.833139 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.844769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.856241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.867855 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.879653 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.891420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.903381 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.914820 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:16:43.926546 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:44.048122 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:44.169328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:44.289837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:16:44.408514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:16:44.616359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:44.926358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16589): Launched 21:16:45.197239 run iperf3-srv_10.42.42.10(pid=16590): Launched 21:16:45.313129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:16:45.519925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:45.832059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16591): Launched 21:16:46.163519 run iperf3-srv_10.42.42.10(pid=16592): Launched 21:16:46.307465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:16:46.537657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:46.879659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16593): Launched 21:16:47.184398 run iperf3-srv_10.42.42.10(pid=16594): Launched 21:16:47.318104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:16:47.541265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:16:47.872876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16595): Launched 21:16:48.161294 run iperf3-srv_10.42.42.10(pid=16596): Launched 21:16:48.285832 tst iperf3m4.py:8: start network... 21:16:48.508094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:16:49.019035 run create_hlr_db(pid=16597): Launched 21:16:49.153506 bus /gobi_6: Setting Powered False 21:16:50.218509 run create_hlr_db(pid=16597): Terminated: ok {rc=0} 21:16:50.655792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16599): Launched 21:16:50.965661 run osmo-hlr_10.42.42.2(pid=16600): Launched 21:16:51.082857 run osmo-stp_10.42.42.5: Starting osmo-stp 21:16:51.626890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16602): Launched 21:16:51.937695 run osmo-stp_10.42.42.5(pid=16603): Launched 21:16:52.056595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:16:52.590222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16605): Launched 21:16:52.715930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:16:52.994813 run patchelf(pid=16606): Launched 21:16:53.179822 run osmo-stp_10.42.42.5(pid=16603): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16603)] 21:16:53.318513 run osmo-stp_10.42.42.5(pid=16603): stdout: | (launched: 2022-12-09_21:16:51.879964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:53.459763 run osmo-stp_10.42.42.5(pid=16603): stderr: | 20221209211652050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211652050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211652050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211652051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211652051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211652051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211652051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:53.600029 run osmo-stp_10.42.42.5(pid=16603): stdout: | (launched: 2022-12-09_21:16:51.879964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:16:53.734690 run osmo-stp_10.42.42.5(pid=16603): stderr: | 20221209211652050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211652050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211652050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211652051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211652051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211652051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211652051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:16:53.894016 run patchelf(pid=16606): Terminating (SIGINT) 21:16:54.077687 run patchelf(pid=16606): Terminated: ok {rc=0} 21:16:54.210098 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16603): Process ended prematurely: osmo-stp_10.42.42.5(pid=16603) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16603)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 21:16:54.220603 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:16:54.249560 run osmo-hlr_10.42.42.2(pid=16600): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16600)] 21:16:54.299351 run osmo-hlr_10.42.42.2(pid=16600): stdout: | (launched: 2022-12-09_21:16:50.908425) 21:16:54.350784 run osmo-hlr_10.42.42.2(pid=16600): stderr: | 20221209211651085 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211651085 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211651085 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211651085 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211651085 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211651085 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211651096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211651107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211651107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211651107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:16:54.402951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16589): Terminating (SIGTERM) 21:16:54.444545 run iperf3-srv_10.42.42.10(pid=16590): Terminating (SIGTERM) 21:16:54.486154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16591): Terminating (SIGTERM) 21:16:54.527656 run iperf3-srv_10.42.42.10(pid=16592): Terminating (SIGTERM) 21:16:54.569055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16593): Terminating (SIGTERM) 21:16:54.610557 run iperf3-srv_10.42.42.10(pid=16594): Terminating (SIGTERM) 21:16:54.651948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16595): Terminating (SIGTERM) 21:16:54.693384 run iperf3-srv_10.42.42.10(pid=16596): Terminating (SIGTERM) 21:16:54.734581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16599): Terminating (SIGTERM) 21:16:54.776029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16602): Terminating (SIGTERM) 21:16:54.817520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16605): Terminating (SIGTERM) 21:16:54.859388 --- ParallelTerminationStrategy: PID 16589 died... 21:16:54.879419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16589): Terminated: ok {rc=0} 21:16:54.925980 --- ParallelTerminationStrategy: PID 16590 died... 21:16:54.945740 run iperf3-srv_10.42.42.10(pid=16590): Terminated {rc=256} 21:16:54.991611 --- ParallelTerminationStrategy: PID 16591 died... 21:16:55.011151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16591): Terminated: ok {rc=0} 21:16:55.057918 --- ParallelTerminationStrategy: PID 16592 died... 21:16:55.077716 run iperf3-srv_10.42.42.10(pid=16592): Terminated {rc=256} 21:16:55.124044 --- ParallelTerminationStrategy: PID 16593 died... 21:16:55.143977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16593): Terminated: ok {rc=0} 21:16:55.190360 --- ParallelTerminationStrategy: PID 16594 died... 21:16:55.209916 run iperf3-srv_10.42.42.10(pid=16594): Terminated {rc=256} 21:16:55.255588 --- ParallelTerminationStrategy: PID 16595 died... 21:16:55.275331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16595): Terminated: ok {rc=0} 21:16:55.321607 --- ParallelTerminationStrategy: PID 16596 died... 21:16:55.341269 run iperf3-srv_10.42.42.10(pid=16596): Terminated {rc=256} 21:16:55.387299 --- ParallelTerminationStrategy: PID 16599 died... 21:16:55.406984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16599): Terminated: ok {rc=0} 21:16:55.453097 --- ParallelTerminationStrategy: PID 16602 died... 21:16:55.472627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16602): Terminated: ok {rc=0} 21:16:55.518728 --- ParallelTerminationStrategy: PID 16605 died... 21:16:55.538499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16605): Terminated: ok {rc=0} 21:16:55.627375 bus /gobi_4: Setting Powered False 21:16:56.726011 bus /gobi_4: Setting Powered False 21:16:57.842891 bus /gobi_1: Setting Powered False 21:16:58.942174 bus /gobi_1: Setting Powered False 21:17:00.058039 bus /gobi_0: Setting Powered False 21:17:01.154276 bus /gobi_0: Setting Powered False 21:17:02.272267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 21:17:03.372297 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.383976 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:17:03.450776 tst ping.py: using LAC 23780 21:17:03.581120 tst ping.py: using RAC 65 21:17:03.702704 tst ping.py: using CellId 23780 21:17:03.823161 tst ping.py: using BVCI 23781 21:17:03.934698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.945835 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.956599 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.967658 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.978647 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:03.989636 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:04.000714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:04.011899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:17:04.130530 tst ping.py:19: start network... 21:17:04.349572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:04.852810 run create_hlr_db(pid=16610): Launched 21:17:04.987113 bus /gobi_6: Setting Powered False 21:17:06.051168 run create_hlr_db(pid=16610): Terminated: ok {rc=0} 21:17:06.503850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16612): Launched 21:17:06.830715 run osmo-hlr_10.42.42.2(pid=16613): Launched 21:17:06.955335 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:07.518010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16615): Launched 21:17:07.841257 run osmo-stp_10.42.42.5(pid=16616): Launched 21:17:07.963208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:08.523309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16618): Launched 21:17:08.647819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:08.921956 run patchelf(pid=16619): Launched 21:17:09.102286 run osmo-stp_10.42.42.5(pid=16616): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16616)] 21:17:09.240066 run osmo-stp_10.42.42.5(pid=16616): stdout: | (launched: 2022-12-09_21:17:07.781299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:09.379894 run osmo-stp_10.42.42.5(pid=16616): stderr: | 20221209211707977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211707978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211707978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211707978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211707979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211707979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211707979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:09.519627 run osmo-stp_10.42.42.5(pid=16616): stdout: | (launched: 2022-12-09_21:17:07.781299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:09.652726 run osmo-stp_10.42.42.5(pid=16616): stderr: | 20221209211707977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211707978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211707978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211707978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211707979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211707979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211707979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:09.810379 run patchelf(pid=16619): Terminating (SIGINT) 21:17:09.991978 run patchelf(pid=16619): Terminated: ok {rc=0} 21:17:10.122603 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16616): Process ended prematurely: osmo-stp_10.42.42.5(pid=16616) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16616)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 21:17:10.132397 tst ping.py:22: Test FAILED (6.8 sec) 21:17:10.160876 run osmo-hlr_10.42.42.2(pid=16613): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16613)] 21:17:10.210918 run osmo-hlr_10.42.42.2(pid=16613): stdout: | (launched: 2022-12-09_21:17:06.770425) 21:17:10.262375 run osmo-hlr_10.42.42.2(pid=16613): stderr: | 20221209211706972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211706972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211706972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211706972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211706972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211706972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211706984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211706992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211706992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211706992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:10.314236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16612): Terminating (SIGTERM) 21:17:10.355523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16615): Terminating (SIGTERM) 21:17:10.397440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16618): Terminating (SIGTERM) 21:17:10.439379 --- ParallelTerminationStrategy: PID 16612 died... 21:17:10.459404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16612): Terminated: ok {rc=0} 21:17:10.505601 --- ParallelTerminationStrategy: PID 16615 died... 21:17:10.525268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16615): Terminated: ok {rc=0} 21:17:10.571038 --- ParallelTerminationStrategy: PID 16618 died... 21:17:10.590817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16618): Terminated: ok {rc=0} 21:17:10.677655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 21:17:11.764601 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:11.776353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 21:17:11.845137 tst ping_idle_ping.py: using LAC 23781 21:17:11.965320 tst ping_idle_ping.py: using RAC 66 21:17:12.083296 tst ping_idle_ping.py: using CellId 23781 21:17:12.204107 tst ping_idle_ping.py: using BVCI 23782 21:17:12.322688 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.334278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.345644 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.356849 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.368540 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.379847 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.391567 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 21:17:12.402886 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 21:17:12.523275 tst ping_idle_ping.py:24: start network... 21:17:12.742018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:13.249072 run create_hlr_db(pid=16620): Launched 21:17:13.381592 bus /gobi_6: Setting Powered False 21:17:14.448130 run create_hlr_db(pid=16620): Terminated: ok {rc=0} 21:17:14.882336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16622): Launched 21:17:15.186799 run osmo-hlr_10.42.42.2(pid=16623): Launched 21:17:15.302534 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:15.852767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16625): Launched 21:17:16.182826 run osmo-stp_10.42.42.5(pid=16626): Launched 21:17:16.479037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:17.061671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16628): Launched 21:17:17.191009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:17.453078 run patchelf(pid=16629): Launched 21:17:17.622247 run osmo-stp_10.42.42.5(pid=16626): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16626)] 21:17:17.750504 run osmo-stp_10.42.42.5(pid=16626): stdout: | (launched: 2022-12-09_21:17:16.122536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:17.881227 run osmo-stp_10.42.42.5(pid=16626): stderr: | 20221209211716315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211716315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211716315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211716316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211716318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211716319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211716319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:18.011474 run osmo-stp_10.42.42.5(pid=16626): stdout: | (launched: 2022-12-09_21:17:16.122536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:18.136539 run osmo-stp_10.42.42.5(pid=16626): stderr: | 20221209211716315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211716315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211716315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211716316 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211716318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211716319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211716319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:18.284464 run patchelf(pid=16629): Terminating (SIGINT) 21:17:18.455107 run patchelf(pid=16629): Terminated: ok {rc=0} 21:17:18.578598 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16626): Process ended prematurely: osmo-stp_10.42.42.5(pid=16626) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16626)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 21:17:18.587747 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 21:17:18.615847 run osmo-hlr_10.42.42.2(pid=16623): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16623)] 21:17:18.663826 run osmo-hlr_10.42.42.2(pid=16623): stdout: | (launched: 2022-12-09_21:17:15.129858) 21:17:18.713913 run osmo-hlr_10.42.42.2(pid=16623): stderr: | 20221209211715311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211715311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211715311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211715311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211715311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211715311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211715321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211715330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211715330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211715330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:18.764196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16622): Terminating (SIGTERM) 21:17:18.804625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16625): Terminating (SIGTERM) 21:17:18.844916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16628): Terminating (SIGTERM) 21:17:18.886195 --- ParallelTerminationStrategy: PID 16622 died... 21:17:18.904924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16622): Terminated: ok {rc=0} 21:17:18.950097 --- ParallelTerminationStrategy: PID 16625 died... 21:17:18.968803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16625): Terminated: ok {rc=0} 21:17:19.013912 --- ParallelTerminationStrategy: PID 16628 died... 21:17:19.032465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16628): Terminated: ok {rc=0} 21:17:19.118732 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 21:17:20.434176 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:17:20.442119 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 21:17:20.474944 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 21:17:20.514057 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 21:17:20.602003 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 21:17:20.634388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 21:17:20.673343 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 21:17:21.277303 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 21:17:21.329429 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.341304 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:21.392171 tst cs_paging_gprs_active.py: using LAC 23782 21:17:21.520115 tst cs_paging_gprs_active.py: using RAC 67 21:17:21.641069 tst cs_paging_gprs_active.py: using CellId 23782 21:17:21.768010 tst cs_paging_gprs_active.py: using BVCI 23783 21:17:21.885839 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.897623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.909181 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.920762 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.932346 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.943820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.955462 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.967121 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:21.978898 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:22.101783 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:22.217695 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 21:17:22.423387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:22.729497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16636): Launched 21:17:22.994327 run iperf3-srv_10.42.42.10(pid=16637): Launched 21:17:23.110310 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 21:17:23.314302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:23.620591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16638): Launched 21:17:23.884526 run iperf3-srv_10.42.42.10(pid=16639): Launched 21:17:23.998421 tst cs_paging_gprs_active.py:38: start network... 21:17:24.202472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:24.678712 run create_hlr_db(pid=16640): Launched 21:17:24.815933 bus /gobi_6: Setting Powered False 21:17:25.879394 run create_hlr_db(pid=16640): Terminated: ok {rc=0} 21:17:26.316014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16642): Launched 21:17:26.622251 run osmo-hlr_10.42.42.2(pid=16643): Launched 21:17:26.739503 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:27.278735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16645): Launched 21:17:27.584318 run osmo-stp_10.42.42.5(pid=16646): Launched 21:17:27.700593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:28.227849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16648): Launched 21:17:28.345344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:28.604522 run patchelf(pid=16649): Launched 21:17:28.773707 run osmo-stp_10.42.42.5(pid=16646): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16646)] 21:17:28.902830 run osmo-stp_10.42.42.5(pid=16646): stdout: | (launched: 2022-12-09_21:17:27.528162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:29.033570 run osmo-stp_10.42.42.5(pid=16646): stderr: | 20221209211727699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211727699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211727699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211727700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211727702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211727702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211727702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:29.164041 run osmo-stp_10.42.42.5(pid=16646): stdout: | (launched: 2022-12-09_21:17:27.528162) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:29.288840 run osmo-stp_10.42.42.5(pid=16646): stderr: | 20221209211727699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211727699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211727699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211727700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211727702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211727702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211727702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:29.436926 run patchelf(pid=16649): Terminating (SIGINT) 21:17:29.608314 run patchelf(pid=16649): Terminated: ok {rc=0} 21:17:29.732015 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16646): Process ended prematurely: osmo-stp_10.42.42.5(pid=16646) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16646)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 21:17:29.741816 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 21:17:29.769427 run osmo-hlr_10.42.42.2(pid=16643): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16643)] 21:17:29.817673 run osmo-hlr_10.42.42.2(pid=16643): stdout: | (launched: 2022-12-09_21:17:26.565882) 21:17:29.867254 run osmo-hlr_10.42.42.2(pid=16643): stderr: | 20221209211726744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211726744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211726744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211726744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211726744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211726744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211726756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211726764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211726764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211726764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:29.917621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16636): Terminating (SIGTERM) 21:17:29.957359 run iperf3-srv_10.42.42.10(pid=16637): Terminating (SIGTERM) 21:17:29.997047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16638): Terminating (SIGTERM) 21:17:30.036856 run iperf3-srv_10.42.42.10(pid=16639): Terminating (SIGTERM) 21:17:30.076490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16642): Terminating (SIGTERM) 21:17:30.116548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16645): Terminating (SIGTERM) 21:17:30.156153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16648): Terminating (SIGTERM) 21:17:30.196041 --- ParallelTerminationStrategy: PID 16636 died... 21:17:30.214910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16636): Terminated: ok {rc=0} 21:17:30.259560 --- ParallelTerminationStrategy: PID 16637 died... 21:17:30.277905 run iperf3-srv_10.42.42.10(pid=16637): Terminated {rc=256} 21:17:30.321695 --- ParallelTerminationStrategy: PID 16638 died... 21:17:30.340174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16638): Terminated: ok {rc=0} 21:17:30.384489 --- ParallelTerminationStrategy: PID 16639 died... 21:17:30.402955 run iperf3-srv_10.42.42.10(pid=16639): Terminated {rc=256} 21:17:30.446764 --- ParallelTerminationStrategy: PID 16642 died... 21:17:30.465142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16642): Terminated: ok {rc=0} 21:17:30.509137 --- ParallelTerminationStrategy: PID 16645 died... 21:17:30.527515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16645): Terminated: ok {rc=0} 21:17:30.571903 --- ParallelTerminationStrategy: PID 16648 died... 21:17:30.590413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16648): Terminated: ok {rc=0} 21:17:30.676160 bus /gobi_0: Setting Powered False 21:17:31.782779 bus /gobi_0: Setting Powered False 21:17:32.911360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 21:17:34.060279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.072705 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:34.123956 tst iperf3.py: using LAC 23783 21:17:34.253100 tst iperf3.py: using RAC 68 21:17:34.381608 tst iperf3.py: using CellId 23783 21:17:34.508895 tst iperf3.py: using BVCI 23784 21:17:34.626497 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.638350 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.650088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.662158 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.673917 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.685480 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.697713 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.709256 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:34.721071 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:34.843168 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:35.062235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:35.387464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16650): Launched 21:17:35.670910 run iperf3-srv_10.42.42.10(pid=16651): Launched 21:17:35.793988 tst iperf3.py:8: start network... 21:17:36.013431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:36.518529 run create_hlr_db(pid=16656): Launched 21:17:36.651742 bus /gobi_6: Setting Powered False 21:17:37.716661 run create_hlr_db(pid=16656): Terminated: ok {rc=0} 21:17:38.151731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16658): Launched 21:17:38.455641 run osmo-hlr_10.42.42.2(pid=16659): Launched 21:17:38.572489 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:39.116028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16661): Launched 21:17:39.421058 run osmo-stp_10.42.42.5(pid=16662): Launched 21:17:39.538263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:40.065873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16664): Launched 21:17:40.182665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:40.440748 run patchelf(pid=16665): Launched 21:17:40.610161 run osmo-stp_10.42.42.5(pid=16662): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16662)] 21:17:40.738854 run osmo-stp_10.42.42.5(pid=16662): stdout: | (launched: 2022-12-09_21:17:39.364477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:40.868906 run osmo-stp_10.42.42.5(pid=16662): stderr: | 20221209211739539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211739539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211739540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211739540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211739541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211739541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211739541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:40.999518 run osmo-stp_10.42.42.5(pid=16662): stdout: | (launched: 2022-12-09_21:17:39.364477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:41.125237 run osmo-stp_10.42.42.5(pid=16662): stderr: | 20221209211739539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211739539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211739540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211739540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211739541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211739541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211739541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:41.273527 run patchelf(pid=16665): Terminating (SIGINT) 21:17:41.444517 run patchelf(pid=16665): Terminated: ok {rc=0} 21:17:41.568883 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16662): Process ended prematurely: osmo-stp_10.42.42.5(pid=16662) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16662)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 21:17:41.578780 tst iperf3.py:8: Test FAILED (7.6 sec) 21:17:41.606302 run osmo-hlr_10.42.42.2(pid=16659): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16659)] 21:17:41.654427 run osmo-hlr_10.42.42.2(pid=16659): stdout: | (launched: 2022-12-09_21:17:38.399596) 21:17:41.703757 run osmo-hlr_10.42.42.2(pid=16659): stderr: | 20221209211738578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211738578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211738578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211738578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211738578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211738578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211738590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211738599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211738599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211738599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:41.753630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16650): Terminating (SIGTERM) 21:17:41.793194 run iperf3-srv_10.42.42.10(pid=16651): Terminating (SIGTERM) 21:17:41.832574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16658): Terminating (SIGTERM) 21:17:41.872071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16661): Terminating (SIGTERM) 21:17:41.911684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16664): Terminating (SIGTERM) 21:17:41.951187 --- ParallelTerminationStrategy: PID 16650 died... 21:17:41.970127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16650): Terminated: ok {rc=0} 21:17:42.013942 --- ParallelTerminationStrategy: PID 16651 died... 21:17:42.032153 run iperf3-srv_10.42.42.10(pid=16651): Terminated {rc=256} 21:17:42.075719 --- ParallelTerminationStrategy: PID 16658 died... 21:17:42.094087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16658): Terminated: ok {rc=0} 21:17:42.137901 --- ParallelTerminationStrategy: PID 16661 died... 21:17:42.156116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16661): Terminated: ok {rc=0} 21:17:42.199767 --- ParallelTerminationStrategy: PID 16664 died... 21:17:42.218077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16664): Terminated: ok {rc=0} 21:17:42.303537 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 21:17:43.450380 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:43.462382 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:17:43.515206 tst iperf3m4.py: using LAC 23784 21:17:43.634510 tst iperf3m4.py: using RAC 69 21:17:43.754283 tst iperf3m4.py: using CellId 23784 21:17:43.877433 tst iperf3m4.py: using BVCI 23785 21:17:43.989296 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.000540 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.011735 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.023329 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.034746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.046101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.057557 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.068934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:17:44.080515 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:44.199280 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:44.316566 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:44.437899 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:17:44.560289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 21:17:44.783021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:45.110877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16666): Launched 21:17:45.396287 run iperf3-srv_10.42.42.10(pid=16667): Launched 21:17:45.519784 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 21:17:45.740327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:46.085757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16668): Launched 21:17:46.379409 run iperf3-srv_10.42.42.10(pid=16669): Launched 21:17:46.509922 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 21:17:46.734190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:47.066432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16670): Launched 21:17:47.362139 run iperf3-srv_10.42.42.10(pid=16671): Launched 21:17:47.485684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 21:17:47.705647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 21:17:48.032210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16672): Launched 21:17:48.315012 run iperf3-srv_10.42.42.10(pid=16673): Launched 21:17:48.438550 tst iperf3m4.py:8: start network... 21:17:48.658452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:17:49.163641 run create_hlr_db(pid=16674): Launched 21:17:49.296309 bus /gobi_6: Setting Powered False 21:17:50.361242 run create_hlr_db(pid=16674): Terminated: ok {rc=0} 21:17:50.815538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16676): Launched 21:17:51.140662 run osmo-hlr_10.42.42.2(pid=16677): Launched 21:17:51.266968 run osmo-stp_10.42.42.5: Starting osmo-stp 21:17:51.828599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16679): Launched 21:17:52.154858 run osmo-stp_10.42.42.5(pid=16680): Launched 21:17:52.280621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:17:52.845373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16682): Launched 21:17:52.969483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:17:53.246209 run patchelf(pid=16683): Launched 21:17:53.427379 run osmo-stp_10.42.42.5(pid=16680): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16680)] 21:17:53.564632 run osmo-stp_10.42.42.5(pid=16680): stdout: | (launched: 2022-12-09_21:17:52.094669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:53.703914 run osmo-stp_10.42.42.5(pid=16680): stderr: | 20221209211752286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211752287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211752287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211752287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211752288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211752288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211752288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:53.843071 run osmo-stp_10.42.42.5(pid=16680): stdout: | (launched: 2022-12-09_21:17:52.094669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:17:53.976240 run osmo-stp_10.42.42.5(pid=16680): stderr: | 20221209211752286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211752287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211752287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211752287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211752288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211752288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211752288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:17:54.134193 run patchelf(pid=16683): Terminating (SIGINT) 21:17:54.316122 run patchelf(pid=16683): Terminated: ok {rc=0} 21:17:54.447766 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16680): Process ended prematurely: osmo-stp_10.42.42.5(pid=16680) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16680)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 21:17:54.458463 tst iperf3m4.py:8: Test FAILED (11.0 sec) 21:17:54.487240 run osmo-hlr_10.42.42.2(pid=16677): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16677)] 21:17:54.536890 run osmo-hlr_10.42.42.2(pid=16677): stdout: | (launched: 2022-12-09_21:17:51.080334) 21:17:54.588133 run osmo-hlr_10.42.42.2(pid=16677): stderr: | 20221209211751278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211751278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211751278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211751278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211751278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211751278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211751290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211751299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211751299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211751299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:17:54.639791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16666): Terminating (SIGTERM) 21:17:54.681211 run iperf3-srv_10.42.42.10(pid=16667): Terminating (SIGTERM) 21:17:54.722361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16668): Terminating (SIGTERM) 21:17:54.763619 run iperf3-srv_10.42.42.10(pid=16669): Terminating (SIGTERM) 21:17:54.804636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16670): Terminating (SIGTERM) 21:17:54.845801 run iperf3-srv_10.42.42.10(pid=16671): Terminating (SIGTERM) 21:17:54.886834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16672): Terminating (SIGTERM) 21:17:54.927943 run iperf3-srv_10.42.42.10(pid=16673): Terminating (SIGTERM) 21:17:54.968914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16676): Terminating (SIGTERM) 21:17:55.010307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16679): Terminating (SIGTERM) 21:17:55.051468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16682): Terminating (SIGTERM) 21:17:55.093093 --- ParallelTerminationStrategy: PID 16666 died... 21:17:55.112749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16666): Terminated: ok {rc=0} 21:17:55.159128 --- ParallelTerminationStrategy: PID 16667 died... 21:17:55.178533 run iperf3-srv_10.42.42.10(pid=16667): Terminated {rc=256} 21:17:55.224018 --- ParallelTerminationStrategy: PID 16668 died... 21:17:55.243303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16668): Terminated: ok {rc=0} 21:17:55.288906 --- ParallelTerminationStrategy: PID 16669 died... 21:17:55.308388 run iperf3-srv_10.42.42.10(pid=16669): Terminated {rc=256} 21:17:55.353906 --- ParallelTerminationStrategy: PID 16670 died... 21:17:55.373612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16670): Terminated: ok {rc=0} 21:17:55.419659 --- ParallelTerminationStrategy: PID 16671 died... 21:17:55.439113 run iperf3-srv_10.42.42.10(pid=16671): Terminated {rc=256} 21:17:55.484914 --- ParallelTerminationStrategy: PID 16672 died... 21:17:55.504330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16672): Terminated: ok {rc=0} 21:17:55.550011 --- ParallelTerminationStrategy: PID 16673 died... 21:17:55.569485 run iperf3-srv_10.42.42.10(pid=16673): Terminated {rc=256} 21:17:55.615461 --- ParallelTerminationStrategy: PID 16676 died... 21:17:55.635018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16676): Terminated: ok {rc=0} 21:17:55.680891 --- ParallelTerminationStrategy: PID 16679 died... 21:17:55.700522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16679): Terminated: ok {rc=0} 21:17:55.746705 --- ParallelTerminationStrategy: PID 16682 died... 21:17:55.766171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16682): Terminated: ok {rc=0} 21:17:55.853831 bus /gobi_4: Setting Powered False 21:17:56.953161 bus /gobi_4: Setting Powered False 21:17:58.068874 bus /gobi_1: Setting Powered False 21:17:59.168481 bus /gobi_1: Setting Powered False 21:18:00.285078 bus /gobi_0: Setting Powered False 21:18:01.381521 bus /gobi_0: Setting Powered False 21:18:02.498886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 21:18:03.602244 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:03.614891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:18:03.665505 tst ping.py: using LAC 23785 21:18:03.788453 tst ping.py: using RAC 70 21:18:03.904911 tst ping.py: using CellId 23785 21:18:04.021354 tst ping.py: using BVCI 23786 21:18:04.129150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.140467 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.151721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.163313 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.174684 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.186125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.197991 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:04.209658 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:18:04.328397 tst ping.py:19: start network... 21:18:04.544548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:05.041530 run create_hlr_db(pid=16684): Launched 21:18:05.173837 bus /gobi_6: Setting Powered False 21:18:06.236690 run create_hlr_db(pid=16684): Terminated: ok {rc=0} 21:18:06.665517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16686): Launched 21:18:06.967268 run osmo-hlr_10.42.42.2(pid=16687): Launched 21:18:07.081795 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:07.620343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16689): Launched 21:18:07.919591 run osmo-stp_10.42.42.5(pid=16690): Launched 21:18:08.033895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:08.553618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16692): Launched 21:18:08.668407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:08.922574 run patchelf(pid=16693): Launched 21:18:09.089113 run osmo-stp_10.42.42.5(pid=16690): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16690)] 21:18:09.215703 run osmo-stp_10.42.42.5(pid=16690): stdout: | (launched: 2022-12-09_21:18:07.864236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:09.344470 run osmo-stp_10.42.42.5(pid=16690): stderr: | 20221209211808033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211808033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211808034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211808034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211808035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211808035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211808035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:09.473364 run osmo-stp_10.42.42.5(pid=16690): stdout: | (launched: 2022-12-09_21:18:07.864236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:09.596020 run osmo-stp_10.42.42.5(pid=16690): stderr: | 20221209211808033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211808033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211808034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211808034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211808035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211808035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211808035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:09.742029 run patchelf(pid=16693): Terminating (SIGINT) 21:18:09.909789 run patchelf(pid=16693): Terminated: ok {rc=0} 21:18:10.030853 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16690): Process ended prematurely: osmo-stp_10.42.42.5(pid=16690) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16690)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 21:18:10.039916 tst ping.py:22: Test FAILED (6.4 sec) 21:18:10.067114 run osmo-hlr_10.42.42.2(pid=16687): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16687)] 21:18:10.115192 run osmo-hlr_10.42.42.2(pid=16687): stdout: | (launched: 2022-12-09_21:18:06.911873) 21:18:10.164675 run osmo-hlr_10.42.42.2(pid=16687): stderr: | 20221209211807086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211807086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211807086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211807086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211807086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211807086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211807100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211807109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211807109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211807109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:10.214723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16686): Terminating (SIGTERM) 21:18:10.254449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16689): Terminating (SIGTERM) 21:18:10.294056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16692): Terminating (SIGTERM) 21:18:10.333888 --- ParallelTerminationStrategy: PID 16686 died... 21:18:10.353025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16686): Terminated: ok {rc=0} 21:18:10.397583 --- ParallelTerminationStrategy: PID 16689 died... 21:18:10.416126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16689): Terminated: ok {rc=0} 21:18:10.460535 --- ParallelTerminationStrategy: PID 16692 died... 21:18:10.479105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16692): Terminated: ok {rc=0} 21:18:10.562989 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 21:18:11.649519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:11.662341 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 21:18:11.714569 tst ping_idle_ping.py: using LAC 23786 21:18:11.843470 tst ping_idle_ping.py: using RAC 71 21:18:11.972026 tst ping_idle_ping.py: using CellId 23786 21:18:12.099837 tst ping_idle_ping.py: using BVCI 23787 21:18:12.216218 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.228246 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.239918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.251600 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.263261 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.274906 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.286775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 21:18:12.298418 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 21:18:12.414338 tst ping_idle_ping.py:24: start network... 21:18:12.615688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:13.082779 run create_hlr_db(pid=16694): Launched 21:18:13.197919 bus /gobi_6: Setting Powered False 21:18:14.258121 run create_hlr_db(pid=16694): Terminated: ok {rc=0} 21:18:14.699249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16696): Launched 21:18:15.022438 run osmo-hlr_10.42.42.2(pid=16697): Launched 21:18:15.146393 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:15.713548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16699): Launched 21:18:16.049677 run osmo-stp_10.42.42.5(pid=16700): Launched 21:18:16.488698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:17.023413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16702): Launched 21:18:17.152839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:17.413122 run patchelf(pid=16703): Launched 21:18:17.579835 run osmo-stp_10.42.42.5(pid=16700): ERR: Terminated: ERROR {rc=1} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16700)] 21:18:17.706459 run osmo-stp_10.42.42.5(pid=16700): stdout: | (launched: 2022-12-09_21:18:15.985728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:17.835392 run osmo-stp_10.42.42.5(pid=16700): stderr: | 20221209211816300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211816301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211816302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211816303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211816304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211816305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211816305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:17.964516 run osmo-stp_10.42.42.5(pid=16700): stdout: | (launched: 2022-12-09_21:18:15.985728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:18.087091 run osmo-stp_10.42.42.5(pid=16700): stderr: | 20221209211816300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211816301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211816302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211816303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211816304 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211816305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211816305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:18.232191 run patchelf(pid=16703): Terminating (SIGINT) 21:18:18.399400 run patchelf(pid=16703): Terminated: ok {rc=0} 21:18:18.520488 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16700): Process ended prematurely: osmo-stp_10.42.42.5(pid=16700) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16700)] [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 21:18:18.530158 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 21:18:18.557538 run osmo-hlr_10.42.42.2(pid=16697): ERR: Terminated: ERROR {rc=237} [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16697)] 21:18:18.605280 run osmo-hlr_10.42.42.2(pid=16697): stdout: | (launched: 2022-12-09_21:18:14.963004) 21:18:18.654752 run osmo-hlr_10.42.42.2(pid=16697): stderr: | 20221209211815172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211815172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211815172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211815172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211815172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211815172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211815185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211815195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211815195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211815195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:18.704750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16696): Terminating (SIGTERM) 21:18:18.744377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16699): Terminating (SIGTERM) 21:18:18.784089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16702): Terminating (SIGTERM) 21:18:18.823771 --- ParallelTerminationStrategy: PID 16696 died... 21:18:18.842808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16696): Terminated: ok {rc=0} 21:18:18.886809 --- ParallelTerminationStrategy: PID 16699 died... 21:18:18.905210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16699): Terminated: ok {rc=0} 21:18:18.949243 --- ParallelTerminationStrategy: PID 16702 died... 21:18:18.967498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16702): Terminated: ok {rc=0} 21:18:19.050901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 21:18:20.373518 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:20.382269 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 21:18:20.417144 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 21:18:20.453130 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 21:18:20.507565 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 21:18:20.540906 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 21:18:20.576435 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 21:18:21.139159 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2364 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 21:18:21.144428 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.156489 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 21:18:21.224353 tst switch_tch_pdch.py: using LAC 23787 21:18:21.348762 tst switch_tch_pdch.py: using RAC 72 21:18:21.473653 tst switch_tch_pdch.py: using CellId 23787 21:18:21.597711 tst switch_tch_pdch.py: using BVCI 23788 21:18:21.714357 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.726791 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.738640 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.750940 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.763274 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.775753 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.788088 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 21:18:21.800431 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:18:21.924043 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 21:18:22.047884 tst switch_tch_pdch.py:51: start network... 21:18:22.264144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:22.760576 run create_hlr_db(pid=16707): Launched 21:18:22.891214 bus /gobi_6: Setting Powered False 21:18:23.955013 run create_hlr_db(pid=16707): Terminated: ok {rc=0} 21:18:24.383723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Launched 21:18:24.681944 run osmo-hlr_10.42.42.2(pid=16710): Launched 21:18:24.795318 run osmo-stp_10.42.42.5: Starting osmo-stp 21:18:25.325162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Launched 21:18:25.624449 run osmo-stp_10.42.42.5(pid=16713): Launched 21:18:25.738286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 21:18:26.255974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16715): Launched 21:18:26.370274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 21:18:26.622892 run patchelf(pid=16716): Launched 21:18:26.788396 run osmo-stp_10.42.42.5(pid=16713): ERR: Terminated: ERROR {rc=1} [trial-2364↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] 21:18:26.914924 run osmo-stp_10.42.42.5(pid=16713): stdout: | (launched: 2022-12-09_21:18:25.569209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:27.043114 run osmo-stp_10.42.42.5(pid=16713): stderr: | 20221209211825739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211825739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211825739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211825740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211825740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211825740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211825741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:27.171267 run osmo-stp_10.42.42.5(pid=16713): stdout: | (launched: 2022-12-09_21:18:25.569209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:18:27.293607 run osmo-stp_10.42.42.5(pid=16713): stderr: | 20221209211825739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211825739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211825739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211825740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211825740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211825740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211825741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:18:27.438347 run patchelf(pid=16716): Terminating (SIGINT) 21:18:27.605716 run patchelf(pid=16716): Terminated: ok {rc=0} 21:18:27.726888 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16713): Process ended prematurely: osmo-stp_10.42.42.5(pid=16713) [trial-2364↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] [trial-2364↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 21:18:27.736037 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 21:18:27.762836 run osmo-hlr_10.42.42.2(pid=16710): ERR: Terminated: ERROR {rc=237} [trial-2364↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16710)] 21:18:27.810852 run osmo-hlr_10.42.42.2(pid=16710): stdout: | (launched: 2022-12-09_21:18:24.626796) 21:18:27.860456 run osmo-hlr_10.42.42.2(pid=16710): stderr: | 20221209211824803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211824803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211824803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211824803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211824803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211824803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211824817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211824828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211824828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211824828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:27.910481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Terminating (SIGTERM) 21:18:27.950144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Terminating (SIGTERM) 21:18:27.989723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16715): Terminating (SIGTERM) 21:18:28.029501 --- ParallelTerminationStrategy: PID 16709 died... 21:18:28.048411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Terminated: ok {rc=0} 21:18:28.092415 --- ParallelTerminationStrategy: PID 16712 died... 21:18:28.110741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Terminated: ok {rc=0} 21:18:28.154393 --- ParallelTerminationStrategy: PID 16715 died... 21:18:28.172728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16715): Terminated: ok {rc=0} 21:18:28.258611 bus /gobi_0: Setting Powered False 21:18:29.358978 bus /gobi_0: Setting Powered False 21:18:30.475153 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2364 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 nitb_smpp --------------------------------------------------------------------- 21:18:31.763304 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:31.768232 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 21:18:31.797314 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 21:18:31.805954 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 21:18:31.846646 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 21:18:31.868717 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 21:18:31.876765 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 21:18:32.392007 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2364 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:18:32.398690 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:32.417682 tst esme_connect_policy_acceptall.py: using MSISDN 7380 21:18:32.552902 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:33.124225 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16720): Launched 21:18:33.430678 run osmo-nitb_10.42.42.2(pid=16721): Launched 21:18:33.601299 run osmo-nitb_10.42.42.2(pid=16721): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16721)] 21:18:33.737462 run osmo-nitb_10.42.42.2(pid=16721): stdout: | (launched: 2022-12-09_21:18:33.374091) 21:18:33.875027 run osmo-nitb_10.42.42.2(pid=16721): stderr: | (launched: 2022-12-09_21:18:33.419351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:34.013455 run osmo-nitb_10.42.42.2(pid=16721): stdout: | (launched: 2022-12-09_21:18:33.374091) 21:18:34.145879 run osmo-nitb_10.42.42.2(pid=16721): stderr: | (launched: 2022-12-09_21:18:33.419351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16721): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16721) [trial-2364↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16721)] 21:18:34.547769 tst osmo-nitb_10.42.42.2(pid=16721): stdout: | (launched: 2022-12-09_21:18:33.374091) 21:18:34.671846 tst osmo-nitb_10.42.42.2(pid=16721): stderr: | (launched: 2022-12-09_21:18:33.419351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:34.817775 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=16721): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16721) [trial-2364↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16721)] [trial-2364↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 21:18:34.826233 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 21:18:34.832752 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16720): Terminating (SIGTERM) 21:18:35.041770 --- ParallelTerminationStrategy: PID 16720 died... 21:18:35.062548 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16720): Terminated: ok {rc=0} ---------------------------------------------- trial-2364 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 21:18:35.111985 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:35.133204 tst esme_connect_policy_closed.py: using MSISDN 7381 21:18:35.258500 tst esme_connect_policy_closed.py: using MSISDN 7382 21:18:35.370870 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:35.941770 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16722): Launched 21:18:36.247883 run osmo-nitb_10.42.42.2(pid=16723): Launched 21:18:36.412490 run osmo-nitb_10.42.42.2(pid=16723): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16723)] 21:18:36.538558 run osmo-nitb_10.42.42.2(pid=16723): stdout: | (launched: 2022-12-09_21:18:36.191410) 21:18:36.666257 run osmo-nitb_10.42.42.2(pid=16723): stderr: | (launched: 2022-12-09_21:18:36.237152) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:36.793843 run osmo-nitb_10.42.42.2(pid=16723): stdout: | (launched: 2022-12-09_21:18:36.191410) 21:18:36.915916 run osmo-nitb_10.42.42.2(pid=16723): stderr: | (launched: 2022-12-09_21:18:36.237152) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:37.061780 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=16723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16723) [trial-2364↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16723)] [trial-2364↪nitb_smpp↪esme_connect_policy_closed.py:24] 21:18:37.070206 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 21:18:37.076774 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16722): Terminating (SIGTERM) 21:18:37.285388 --- ParallelTerminationStrategy: PID 16722 died... 21:18:37.306910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16722): Terminated: ok {rc=0} ---------------------------------------------- trial-2364 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:18:37.358360 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:37.370210 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:18:37.408110 tst esme_ms_sms_storeforward.py: using LAC 23788 21:18:37.541587 tst esme_ms_sms_storeforward.py: using RAC 73 21:18:37.672578 tst esme_ms_sms_storeforward.py: using CellId 23788 21:18:37.801994 tst esme_ms_sms_storeforward.py: using BVCI 23789 21:18:37.923258 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:18:38.049860 tst esme_ms_sms_storeforward.py: using MSISDN 7383 21:18:38.169749 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 21:18:38.392685 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:39.064754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16724): Launched 21:18:39.394581 run osmo-nitb_10.42.42.2(pid=16725): Launched 21:18:39.573685 run osmo-nitb_10.42.42.2(pid=16725): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16725)] 21:18:39.709058 run osmo-nitb_10.42.42.2(pid=16725): stdout: | (launched: 2022-12-09_21:18:39.334330) 21:18:39.845775 run osmo-nitb_10.42.42.2(pid=16725): stderr: | (launched: 2022-12-09_21:18:39.383457) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:39.983315 run osmo-nitb_10.42.42.2(pid=16725): stdout: | (launched: 2022-12-09_21:18:39.334330) 21:18:40.114599 run osmo-nitb_10.42.42.2(pid=16725): stderr: | (launched: 2022-12-09_21:18:39.383457) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:40.271589 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=16725): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16725) [trial-2364↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16725)] [trial-2364↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 21:18:40.280757 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 21:18:40.288084 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16724): Terminating (SIGTERM) 21:18:40.498479 --- ParallelTerminationStrategy: PID 16724 died... 21:18:40.519912 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16724): Terminated: ok {rc=0} 21:18:40.606639 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:18:41.695139 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 21:18:41.706749 tst nitb_smpp: Using 1 x bts (candidates: 1) 21:18:41.744161 tst esme_ms_sms_transaction.py: using LAC 23789 21:18:41.875420 tst esme_ms_sms_transaction.py: using RAC 74 21:18:42.006419 tst esme_ms_sms_transaction.py: using CellId 23789 21:18:42.137441 tst esme_ms_sms_transaction.py: using BVCI 23790 21:18:42.258346 tst nitb_smpp: Using 1 x modem (candidates: 1) 21:18:42.387067 tst esme_ms_sms_transaction.py: using MSISDN 7384 21:18:42.500711 tst esme_ms_sms_transaction.py:18: start nitb and bts... 21:18:42.706806 run osmo-nitb_10.42.42.2: Starting osmo-nitb 21:18:43.330894 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16726): Launched 21:18:43.639069 run osmo-nitb_10.42.42.2(pid=16727): Launched 21:18:43.808533 run osmo-nitb_10.42.42.2(pid=16727): ERR: Terminated: ERROR {rc=2} [trial-2364↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16727)] 21:18:43.945103 run osmo-nitb_10.42.42.2(pid=16727): stdout: | (launched: 2022-12-09_21:18:43.582793) 21:18:44.083745 run osmo-nitb_10.42.42.2(pid=16727): stderr: | (launched: 2022-12-09_21:18:43.628244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:44.221848 run osmo-nitb_10.42.42.2(pid=16727): stdout: | (launched: 2022-12-09_21:18:43.582793) 21:18:44.355145 run osmo-nitb_10.42.42.2(pid=16727): stderr: | (launched: 2022-12-09_21:18:43.628244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f7784776268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16727): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16727) [trial-2364↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16727)] 21:18:44.754991 tst osmo-nitb_10.42.42.2(pid=16727): stdout: | (launched: 2022-12-09_21:18:43.582793) 21:18:44.879572 tst osmo-nitb_10.42.42.2(pid=16727): stderr: | (launched: 2022-12-09_21:18:43.628244) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 21:18:45.026292 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=16727): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16727) [trial-2364↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16727)] [trial-2364↪nitb_smpp↪esme_ms_sms_transaction.py:21] 21:18:45.035174 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 21:18:45.041943 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16726): Terminating (SIGTERM) 21:18:45.250955 --- ParallelTerminationStrategy: PID 16726 died... 21:18:45.272040 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16726): Terminated: ok {rc=0} 21:18:45.358975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 smpp --------------------------------------------------------------------- 21:18:46.534173 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:18:46.538267 tst smpp: Verifying 1 x bts (candidates: 11) 21:18:46.569768 tst smpp: Verifying 6 x ip_address (candidates: 9) 21:18:46.604873 tst smpp: Verifying 1 x modem (candidates: 12) 21:18:46.647341 tst smpp: Reserving 1 x bts (candidates: 11) 21:18:46.675672 tst smpp: Reserving 6 x ip_address (candidates: 9) 21:18:46.715251 tst smpp: Reserving 1 x modem (candidates: 12) 21:18:47.226159 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 21:18:47.236119 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.252154 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.264111 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.275583 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:47.296532 tst esme_connect_policy_acceptall.py: using MSISDN 7385 21:18:47.411745 run osmo-stp_10.42.42.4: Starting osmo-stp 21:18:47.941071 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16731): Launched 21:18:48.249968 run osmo-stp_10.42.42.4(pid=16732): Launched 21:18:48.367601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:48.846257 run create_hlr_db(pid=16733): Launched 21:18:48.967628 bus /sierra_2: Setting Powered False 21:18:50.028149 run create_hlr_db(pid=16733): Terminated: ok {rc=0} 21:18:50.456549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Launched 21:18:50.764036 run osmo-hlr_10.42.42.2(pid=16736): Launched 21:18:50.881686 run osmo-msc_10.42.42.5: Starting osmo-msc 21:18:51.490761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Launched 21:18:51.820501 run osmo-msc_10.42.42.5(pid=16739): Launched 21:18:52.004365 run osmo-hlr_10.42.42.2(pid=16736): ERR: Terminated: ERROR {rc=237} [trial-2364↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16736)] 21:18:52.145850 run osmo-hlr_10.42.42.2(pid=16736): stdout: | (launched: 2022-12-09_21:18:50.707261) 21:18:52.284587 run osmo-hlr_10.42.42.2(pid=16736): stderr: | 20221209211850881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211850882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211850895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211850905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211850905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211850905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:52.423588 run osmo-hlr_10.42.42.2(pid=16736): stdout: | (launched: 2022-12-09_21:18:50.707261) 21:18:52.555350 run osmo-hlr_10.42.42.2(pid=16736): stderr: | 20221209211850881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211850881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211850882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211850895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211850905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211850905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211850905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:52.712842 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=16736): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16736) [trial-2364↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16736)] [trial-2364↪smpp↪esme_connect_policy_acceptall.py:23] 21:18:52.722295 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 21:18:52.750101 run osmo-msc_10.42.42.5(pid=16739): ERR: Terminated: ERROR {rc=9} [trial-2364↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16739)] 21:18:52.800221 run osmo-msc_10.42.42.5(pid=16739): stdout: | (launched: 2022-12-09_21:18:51.760288) 21:18:52.852073 run osmo-msc_10.42.42.5(pid=16739): stderr: | 20221209211852125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209211852125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209211852125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211852125 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209211852125 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209211852125 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209211852125 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209211852125 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209211852126 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:18:52.904524 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16731): Terminating (SIGTERM) 21:18:52.946045 run osmo-stp_10.42.42.4(pid=16732): Terminating (SIGTERM) 21:18:52.987370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Terminating (SIGTERM) 21:18:53.030394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Terminating (SIGTERM) 21:18:53.075035 --- ParallelTerminationStrategy: PID 16731 died... 21:18:53.095426 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16731): Terminated: ok {rc=0} 21:18:53.144002 --- ParallelTerminationStrategy: PID 16732 died... 21:18:53.163579 run osmo-stp_10.42.42.4(pid=16732): Terminated: ok {rc=0} 21:18:53.210159 --- ParallelTerminationStrategy: PID 16735 died... 21:18:53.229689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Terminated: ok {rc=0} 21:18:53.276149 --- ParallelTerminationStrategy: PID 16738 died... 21:18:53.295825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Terminated: ok {rc=0} ---------------------------------------------- trial-2364 smpp esme_connect_policy_closed.py ---------------------------------------------- 21:18:53.347471 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:53.359145 tst smpp: Using 1 x bts (candidates: 1) 21:18:53.395761 tst esme_connect_policy_closed.py: using LAC 23790 21:18:53.527366 tst esme_connect_policy_closed.py: using RAC 75 21:18:53.657884 tst esme_connect_policy_closed.py: using CellId 23790 21:18:53.780353 tst esme_connect_policy_closed.py: using BVCI 23791 21:18:53.893894 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:53.904768 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:53.915241 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:53.935150 tst esme_connect_policy_closed.py: using MSISDN 7386 21:18:54.055966 tst esme_connect_policy_closed.py: using MSISDN 7387 21:18:54.169803 run osmo-stp_10.42.42.4: Starting osmo-stp 21:18:54.695086 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16742): Launched 21:18:55.003514 run osmo-stp_10.42.42.4(pid=16743): Launched 21:18:55.121829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:18:55.602911 run create_hlr_db(pid=16744): Launched 21:18:56.777902 run create_hlr_db(pid=16744): Terminated: ok {rc=0} 21:18:57.104370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Launched 21:18:57.414163 run osmo-hlr_10.42.42.2(pid=16747): Launched 21:18:57.531612 run osmo-msc_10.42.42.5: Starting osmo-msc 21:18:58.105844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Launched 21:18:58.414955 run osmo-msc_10.42.42.5(pid=16750): Launched 21:18:58.588942 run osmo-hlr_10.42.42.2(pid=16747): ERR: Terminated: ERROR {rc=237} [trial-2364↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16747)] 21:18:58.723358 run osmo-hlr_10.42.42.2(pid=16747): stdout: | (launched: 2022-12-09_21:18:57.356716) 21:18:58.855230 run osmo-hlr_10.42.42.2(pid=16747): stderr: | 20221209211857533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211857533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211857543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211857551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211857552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211857552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:58.984109 run osmo-hlr_10.42.42.2(pid=16747): stdout: | (launched: 2022-12-09_21:18:57.356716) 21:18:59.106973 run osmo-hlr_10.42.42.2(pid=16747): stderr: | 20221209211857533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211857533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211857533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211857543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211857551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211857552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211857552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:18:59.254232 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=16747): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16747) [trial-2364↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16747)] [trial-2364↪smpp↪esme_connect_policy_closed.py:31] 21:18:59.262597 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 21:18:59.288830 run osmo-msc_10.42.42.5(pid=16750): ERR: Terminated: ERROR {rc=9} [trial-2364↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16750)] 21:18:59.337257 run osmo-msc_10.42.42.5(pid=16750): stdout: | (launched: 2022-12-09_21:18:58.357743) 21:18:59.386800 run osmo-msc_10.42.42.5(pid=16750): stderr: | 20221209211858679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209211858679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209211858679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211858679 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209211858679 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209211858679 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209211858679 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209211858679 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209211858680 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 21:18:59.436509 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16742): Terminating (SIGTERM) 21:18:59.476275 run osmo-stp_10.42.42.4(pid=16743): Terminating (SIGTERM) 21:18:59.515783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Terminating (SIGTERM) 21:18:59.557068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Terminating (SIGTERM) 21:18:59.598021 --- ParallelTerminationStrategy: PID 16742 died... 21:18:59.617075 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16742): Terminated: ok {rc=0} 21:18:59.661587 --- ParallelTerminationStrategy: PID 16743 died... 21:18:59.679925 run osmo-stp_10.42.42.4(pid=16743): Terminated: ok {rc=0} 21:18:59.724157 --- ParallelTerminationStrategy: PID 16746 died... 21:18:59.742693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Terminated: ok {rc=0} 21:18:59.786927 --- ParallelTerminationStrategy: PID 16749 died... 21:18:59.805410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Terminated: ok {rc=0} ---------------------------------------------- trial-2364 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 21:18:59.854157 tst smpp: Using 1 x ip_address (candidates: 6) 21:18:59.865307 tst smpp: Using 1 x bts (candidates: 1) 21:18:59.900753 tst esme_ms_sms_storeforward.py: using LAC 23791 21:19:00.037886 tst esme_ms_sms_storeforward.py: using RAC 76 21:19:00.167837 tst esme_ms_sms_storeforward.py: using CellId 23791 21:19:00.298100 tst esme_ms_sms_storeforward.py: using BVCI 23792 21:19:00.419058 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:00.430176 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:00.441282 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:00.452786 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:00.464272 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:00.475841 tst smpp: Using 1 x modem (candidates: 1) 21:19:00.603531 tst esme_ms_sms_storeforward.py: using MSISDN 7388 21:19:00.716180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:01.241971 run create_hlr_db(pid=16753): Launched 21:19:02.455527 run create_hlr_db(pid=16753): Terminated: ok {rc=0} 21:19:02.805917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Launched 21:19:03.136369 run osmo-hlr_10.42.42.2(pid=16756): Launched 21:19:03.263083 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:03.838621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Launched 21:19:04.171474 run osmo-stp_10.42.42.5(pid=16759): Launched 21:19:04.298550 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:04.898889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16761): Launched 21:19:05.229491 run osmo-msc_10.42.42.6(pid=16762): Launched 21:19:05.413317 run osmo-stp_10.42.42.5(pid=16759): ERR: Terminated: ERROR {rc=1} [trial-2364↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] 21:19:05.552543 run osmo-stp_10.42.42.5(pid=16759): stdout: | (launched: 2022-12-09_21:19:04.109900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:05.691920 run osmo-stp_10.42.42.5(pid=16759): stderr: | 20221209211904306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211904306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211904307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211904307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211904307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211904308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211904308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:05.829997 run osmo-stp_10.42.42.5(pid=16759): stdout: | (launched: 2022-12-09_21:19:04.109900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:05.961762 run osmo-stp_10.42.42.5(pid=16759): stderr: | 20221209211904306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211904306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211904307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211904307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211904307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211904308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211904308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:06.119162 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=16759): Process ended prematurely: osmo-stp_10.42.42.5(pid=16759) [trial-2364↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] [trial-2364↪smpp↪esme_ms_sms_storeforward.py:30] 21:19:06.128214 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 21:19:06.155878 run osmo-hlr_10.42.42.2(pid=16756): ERR: Terminated: ERROR {rc=237} [trial-2364↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16756)] 21:19:06.206018 run osmo-hlr_10.42.42.2(pid=16756): stdout: | (launched: 2022-12-09_21:19:03.075843) 21:19:06.257538 run osmo-hlr_10.42.42.2(pid=16756): stderr: | 20221209211903273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211903273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211903273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211903273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211903274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211903274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211903322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211903331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211903331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211903332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:06.329696 run osmo-msc_10.42.42.6(pid=16762): ERR: Terminated: ERROR {rc=2} [trial-2364↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16762)] 21:19:06.379628 run osmo-msc_10.42.42.6(pid=16762): stdout: | (launched: 2022-12-09_21:19:05.168714) 21:19:06.431136 run osmo-msc_10.42.42.6(pid=16762): stderr: | 20221209211905497 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211905497 DLGLOBAL DEBUG validating counter group 0x7fe05613cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211905497 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211905497 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211905497 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211905498 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211905499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211905500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211905500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211905500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:06.483424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Terminating (SIGTERM) 21:19:06.525352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Terminating (SIGTERM) 21:19:06.567167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16761): Terminating (SIGTERM) 21:19:06.609515 --- ParallelTerminationStrategy: PID 16755 died... 21:19:06.629707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16755): Terminated: ok {rc=0} 21:19:06.675897 --- ParallelTerminationStrategy: PID 16758 died... 21:19:06.695539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16758): Terminated: ok {rc=0} 21:19:06.741602 --- ParallelTerminationStrategy: PID 16761 died... 21:19:06.761189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16761): Terminated: ok {rc=0} 21:19:06.849622 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 smpp esme_ms_sms_transaction.py ---------------------------------------------- 21:19:07.938398 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:07.950529 tst smpp: Using 1 x bts (candidates: 1) 21:19:07.991640 tst esme_ms_sms_transaction.py: using LAC 23792 21:19:08.121497 tst esme_ms_sms_transaction.py: using RAC 77 21:19:08.253209 tst esme_ms_sms_transaction.py: using CellId 23792 21:19:08.382090 tst esme_ms_sms_transaction.py: using BVCI 23793 21:19:08.495623 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:08.506246 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:08.516582 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:08.527826 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:08.539083 tst smpp: Using 1 x ip_address (candidates: 6) 21:19:08.550330 tst smpp: Using 1 x modem (candidates: 1) 21:19:08.681451 tst esme_ms_sms_transaction.py: using MSISDN 7389 21:19:08.802901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:09.314487 run create_hlr_db(pid=16764): Launched 21:19:09.448226 bus /sierra_2: Setting Powered False 21:19:10.513083 run create_hlr_db(pid=16764): Terminated: ok {rc=0} 21:19:10.951875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16766): Launched 21:19:11.261768 run osmo-hlr_10.42.42.2(pid=16767): Launched 21:19:11.380198 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:11.950556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16769): Launched 21:19:12.258808 run osmo-stp_10.42.42.5(pid=16770): Launched 21:19:12.379540 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:12.935260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16772): Launched 21:19:13.246284 run osmo-msc_10.42.42.6(pid=16773): Launched 21:19:13.419061 run osmo-stp_10.42.42.5(pid=16770): ERR: Terminated: ERROR {rc=1} [trial-2364↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16770)] 21:19:13.549563 run osmo-stp_10.42.42.5(pid=16770): stdout: | (launched: 2022-12-09_21:19:12.201596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:13.680050 run osmo-stp_10.42.42.5(pid=16770): stderr: | 20221209211912374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211912375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211912375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211912375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211912376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211912376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211912376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:13.808731 run osmo-stp_10.42.42.5(pid=16770): stdout: | (launched: 2022-12-09_21:19:12.201596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:13.931396 run osmo-stp_10.42.42.5(pid=16770): stderr: | 20221209211912374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211912375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211912375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211912375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211912376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211912376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211912376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:14.078189 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=16770): Process ended prematurely: osmo-stp_10.42.42.5(pid=16770) [trial-2364↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16770)] [trial-2364↪smpp↪esme_ms_sms_transaction.py:28] 21:19:14.086655 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 21:19:14.113284 run osmo-hlr_10.42.42.2(pid=16767): ERR: Terminated: ERROR {rc=237} [trial-2364↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16767)] 21:19:14.161111 run osmo-hlr_10.42.42.2(pid=16767): stdout: | (launched: 2022-12-09_21:19:11.204801) 21:19:14.210367 run osmo-hlr_10.42.42.2(pid=16767): stderr: | 20221209211911382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211911382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211911382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211911382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211911382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211911382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211911395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211911404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211911404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211911404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:14.279535 run osmo-msc_10.42.42.6(pid=16773): ERR: Terminated: ERROR {rc=2} [trial-2364↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16773)] 21:19:14.327078 run osmo-msc_10.42.42.6(pid=16773): stdout: | (launched: 2022-12-09_21:19:13.188449) 21:19:14.376152 run osmo-msc_10.42.42.6(pid=16773): stderr: | 20221209211913463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211913463 DLGLOBAL DEBUG validating counter group 0x7f68974fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211913463 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211913463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211913464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211913464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211913466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211913466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211913466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211913466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:14.425722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16766): Terminating (SIGTERM) 21:19:14.465156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16769): Terminating (SIGTERM) 21:19:14.504561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16772): Terminating (SIGTERM) 21:19:14.544296 --- ParallelTerminationStrategy: PID 16766 died... 21:19:14.563270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16766): Terminated: ok {rc=0} 21:19:14.607321 --- ParallelTerminationStrategy: PID 16769 died... 21:19:14.625810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16769): Terminated: ok {rc=0} 21:19:14.669812 --- ParallelTerminationStrategy: PID 16772 died... 21:19:14.688465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16772): Terminated: ok {rc=0} 21:19:14.775248 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 encryption --------------------------------------------------------------------- 21:19:15.997975 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:19:16.001491 tst encryption: Verifying 1 x bts (candidates: 11) 21:19:16.037209 tst encryption: Verifying 6 x ip_address (candidates: 9) 21:19:16.072267 tst encryption: Verifying 1 x modem (candidates: 12) 21:19:16.113805 tst encryption: Reserving 1 x bts (candidates: 11) 21:19:16.146658 tst encryption: Reserving 6 x ip_address (candidates: 9) 21:19:16.177804 tst encryption: Reserving 1 x modem (candidates: 12) 21:19:16.700290 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2364 encryption register_a5_0_authopt.py ---------------------------------------------- 21:19:16.755999 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:16.767726 tst encryption: Using 1 x bts (candidates: 1) 21:19:16.805709 tst register_a5_0_authopt.py: using LAC 23793 21:19:16.966427 tst register_a5_0_authopt.py: using RAC 78 21:19:17.101281 tst register_a5_0_authopt.py: using CellId 23793 21:19:17.225740 tst register_a5_0_authopt.py: using BVCI 23794 21:19:17.357668 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:17.368551 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:17.379474 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:17.391433 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:17.403198 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:17.414045 tst encryption: Using 1 x modem (candidates: 1) 21:19:17.534551 tst register_a5_0_authopt.py:8: start network... 21:19:17.745116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:18.226726 run create_hlr_db(pid=16778): Launched 21:19:18.346983 bus /sierra_2: Setting Powered False 21:19:19.407998 run create_hlr_db(pid=16778): Terminated: ok {rc=0} 21:19:19.862895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16780): Launched 21:19:20.198298 run osmo-hlr_10.42.42.2(pid=16781): Launched 21:19:20.328095 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:20.906401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16783): Launched 21:19:21.240392 run osmo-stp_10.42.42.5(pid=16784): Launched 21:19:21.367160 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:21.967560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16786): Launched 21:19:22.304637 run osmo-msc_10.42.42.6(pid=16787): Launched 21:19:22.492699 run osmo-stp_10.42.42.5(pid=16784): ERR: Terminated: ERROR {rc=1} [trial-2364↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16784)] 21:19:22.632623 run osmo-stp_10.42.42.5(pid=16784): stdout: | (launched: 2022-12-09_21:19:21.178728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:22.773812 run osmo-stp_10.42.42.5(pid=16784): stderr: | 20221209211921374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211921375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211921375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211921375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211921376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211921376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211921376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:22.912429 run osmo-stp_10.42.42.5(pid=16784): stdout: | (launched: 2022-12-09_21:19:21.178728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:23.045600 run osmo-stp_10.42.42.5(pid=16784): stderr: | 20221209211921374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211921375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211921375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211921375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211921376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211921376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211921376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:23.204159 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16784): Process ended prematurely: osmo-stp_10.42.42.5(pid=16784) [trial-2364↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16784)] [trial-2364↪encryption↪register_a5_0_authopt.py:8] 21:19:23.214129 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 21:19:23.242323 run osmo-hlr_10.42.42.2(pid=16781): ERR: Terminated: ERROR {rc=237} [trial-2364↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16781)] 21:19:23.292283 run osmo-hlr_10.42.42.2(pid=16781): stdout: | (launched: 2022-12-09_21:19:20.137110) 21:19:23.344197 run osmo-hlr_10.42.42.2(pid=16781): stderr: | 20221209211920339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211920339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211920339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211920339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211920339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211920339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211920351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211920359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211920360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211920360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:23.416103 run osmo-msc_10.42.42.6(pid=16787): ERR: Terminated: ERROR {rc=2} [trial-2364↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16787)] 21:19:23.466493 run osmo-msc_10.42.42.6(pid=16787): stdout: | (launched: 2022-12-09_21:19:22.241967) 21:19:23.518442 run osmo-msc_10.42.42.6(pid=16787): stderr: | 20221209211922570 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211922570 DLGLOBAL DEBUG validating counter group 0x7faf21095c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211922570 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211922570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211922570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211922570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211922572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211922572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211922572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211922573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:23.570413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16780): Terminating (SIGTERM) 21:19:23.612035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16783): Terminating (SIGTERM) 21:19:23.653808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16786): Terminating (SIGTERM) 21:19:23.696010 --- ParallelTerminationStrategy: PID 16780 died... 21:19:23.715952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16780): Terminated: ok {rc=0} 21:19:23.762268 --- ParallelTerminationStrategy: PID 16783 died... 21:19:23.781827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16783): Terminated: ok {rc=0} 21:19:23.827980 --- ParallelTerminationStrategy: PID 16786 died... 21:19:23.847515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16786): Terminated: ok {rc=0} 21:19:23.934958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 encryption register_a5_0_authreq.py ---------------------------------------------- 21:19:25.088117 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.099931 tst encryption: Using 1 x bts (candidates: 1) 21:19:25.137575 tst register_a5_0_authreq.py: using LAC 23794 21:19:25.270720 tst register_a5_0_authreq.py: using RAC 79 21:19:25.403927 tst register_a5_0_authreq.py: using CellId 23794 21:19:25.537262 tst register_a5_0_authreq.py: using BVCI 23795 21:19:25.658741 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.669977 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.680918 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.692093 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.703433 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:25.714636 tst encryption: Using 1 x modem (candidates: 1) 21:19:25.832729 tst register_a5_0_authreq.py:8: start network... 21:19:26.043100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:26.526015 run create_hlr_db(pid=16789): Launched 21:19:26.647341 bus /sierra_2: Setting Powered False 21:19:27.708487 run create_hlr_db(pid=16789): Terminated: ok {rc=0} 21:19:28.162851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Launched 21:19:28.498362 run osmo-hlr_10.42.42.2(pid=16792): Launched 21:19:28.627798 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:29.202191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Launched 21:19:29.536069 run osmo-stp_10.42.42.5(pid=16795): Launched 21:19:29.665350 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:30.266861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16797): Launched 21:19:30.602719 run osmo-msc_10.42.42.6(pid=16798): Launched 21:19:30.789312 run osmo-stp_10.42.42.5(pid=16795): ERR: Terminated: ERROR {rc=1} [trial-2364↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] 21:19:31.083364 run osmo-stp_10.42.42.5(pid=16795): stdout: | (launched: 2022-12-09_21:19:29.474757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:31.300781 run osmo-stp_10.42.42.5(pid=16795): stderr: | 20221209211929669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211929669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211929670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211929670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211929670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211929671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211929671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:31.441961 run osmo-stp_10.42.42.5(pid=16795): stdout: | (launched: 2022-12-09_21:19:29.474757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:31.577411 run osmo-stp_10.42.42.5(pid=16795): stderr: | 20221209211929669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211929669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211929670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211929670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211929670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211929671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211929671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:31.738396 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16795): Process ended prematurely: osmo-stp_10.42.42.5(pid=16795) [trial-2364↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] [trial-2364↪encryption↪register_a5_0_authreq.py:8] 21:19:31.749178 tst register_a5_0_authreq.py:8: Test FAILED (6.7 sec) 21:19:31.778693 run osmo-hlr_10.42.42.2(pid=16792): ERR: Terminated: ERROR {rc=237} [trial-2364↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16792)] 21:19:31.831175 run osmo-hlr_10.42.42.2(pid=16792): stdout: | (launched: 2022-12-09_21:19:28.436706) 21:19:31.884025 run osmo-hlr_10.42.42.2(pid=16792): stderr: | 20221209211928639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211928639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211928639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211928639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211928639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211928639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211928655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211928664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211928665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211928665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:31.957669 run osmo-msc_10.42.42.6(pid=16798): ERR: Terminated: ERROR {rc=2} [trial-2364↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16798)] 21:19:32.009111 run osmo-msc_10.42.42.6(pid=16798): stdout: | (launched: 2022-12-09_21:19:30.541488) 21:19:32.061772 run osmo-msc_10.42.42.6(pid=16798): stderr: | 20221209211930865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211930866 DLGLOBAL DEBUG validating counter group 0x7f3741e55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211930866 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211930866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211930866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211930866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211930868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211930868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211930868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211930868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:32.114684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Terminating (SIGTERM) 21:19:32.157560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Terminating (SIGTERM) 21:19:32.200224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16797): Terminating (SIGTERM) 21:19:32.243191 --- ParallelTerminationStrategy: PID 16791 died... 21:19:32.263433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16791): Terminated: ok {rc=0} 21:19:32.311073 --- ParallelTerminationStrategy: PID 16794 died... 21:19:32.330942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16794): Terminated: ok {rc=0} 21:19:32.377971 --- ParallelTerminationStrategy: PID 16797 died... 21:19:32.397988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16797): Terminated: ok {rc=0} 21:19:32.486854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 encryption register_a5_1_authreq.py ---------------------------------------------- 21:19:33.640374 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:33.655985 tst encryption: Using 1 x bts (candidates: 1) 21:19:33.691310 tst register_a5_1_authreq.py: using LAC 23795 21:19:33.819651 tst register_a5_1_authreq.py: using RAC 80 21:19:33.950509 tst register_a5_1_authreq.py: using CellId 23795 21:19:34.084725 tst register_a5_1_authreq.py: using BVCI 23796 21:19:34.207601 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:34.218783 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:34.229568 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:34.240426 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:34.251451 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:34.262330 tst encryption: Using 1 x modem (candidates: 1) 21:19:34.381891 tst register_a5_1_authreq.py:8: start network... 21:19:34.609331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:35.127733 run create_hlr_db(pid=16800): Launched 21:19:35.263065 bus /sierra_2: Setting Powered False 21:19:36.328753 run create_hlr_db(pid=16800): Terminated: ok {rc=0} 21:19:36.775371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Launched 21:19:37.088887 run osmo-hlr_10.42.42.2(pid=16803): Launched 21:19:37.207445 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:37.748024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Launched 21:19:38.060444 run osmo-stp_10.42.42.5(pid=16806): Launched 21:19:38.179379 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:38.755565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Launched 21:19:39.067994 run osmo-msc_10.42.42.6(pid=16809): Launched 21:19:39.242531 run osmo-stp_10.42.42.5(pid=16806): ERR: Terminated: ERROR {rc=1} [trial-2364↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] 21:19:39.374708 run osmo-stp_10.42.42.5(pid=16806): stdout: | (launched: 2022-12-09_21:19:38.002734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:39.505820 run osmo-stp_10.42.42.5(pid=16806): stderr: | 20221209211938176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211938176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211938176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211938177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211938179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211938179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211938179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:39.634954 run osmo-stp_10.42.42.5(pid=16806): stdout: | (launched: 2022-12-09_21:19:38.002734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:39.758701 run osmo-stp_10.42.42.5(pid=16806): stderr: | 20221209211938176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211938176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211938176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211938177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211938179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211938179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211938179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:39.907854 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16806): Process ended prematurely: osmo-stp_10.42.42.5(pid=16806) [trial-2364↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] [trial-2364↪encryption↪register_a5_1_authreq.py:8] 21:19:39.916863 tst register_a5_1_authreq.py:8: Test FAILED (6.3 sec) 21:19:39.943563 run osmo-hlr_10.42.42.2(pid=16803): ERR: Terminated: ERROR {rc=237} [trial-2364↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16803)] 21:19:39.991543 run osmo-hlr_10.42.42.2(pid=16803): stdout: | (launched: 2022-12-09_21:19:37.031565) 21:19:40.040549 run osmo-hlr_10.42.42.2(pid=16803): stderr: | 20221209211937208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211937208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211937208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211937208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211937208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211937208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211937220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211937229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211937229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211937229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:40.109075 run osmo-msc_10.42.42.6(pid=16809): ERR: Terminated: ERROR {rc=2} [trial-2364↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16809)] 21:19:40.156474 run osmo-msc_10.42.42.6(pid=16809): stdout: | (launched: 2022-12-09_21:19:39.010215) 21:19:40.205633 run osmo-msc_10.42.42.6(pid=16809): stderr: | 20221209211939284 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211939284 DLGLOBAL DEBUG validating counter group 0x7ff6dac9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211939284 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211939284 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211939284 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211939284 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211939286 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211939286 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211939287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211939287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:40.255244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Terminating (SIGTERM) 21:19:40.294599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Terminating (SIGTERM) 21:19:40.334868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Terminating (SIGTERM) 21:19:40.374862 --- ParallelTerminationStrategy: PID 16802 died... 21:19:40.394003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16802): Terminated: ok {rc=0} 21:19:40.438932 --- ParallelTerminationStrategy: PID 16805 died... 21:19:40.457824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16805): Terminated: ok {rc=0} 21:19:40.502095 --- ParallelTerminationStrategy: PID 16808 died... 21:19:40.521074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16808): Terminated: ok {rc=0} 21:19:40.605554 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2364 encryption register_a5_3_authreq.py ---------------------------------------------- 21:19:41.751121 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:41.762263 tst encryption: Using 1 x bts (candidates: 1) 21:19:41.798667 tst register_a5_3_authreq.py: using LAC 23796 21:19:41.922278 tst register_a5_3_authreq.py: using RAC 81 21:19:42.045737 tst register_a5_3_authreq.py: using CellId 23796 21:19:42.181628 tst register_a5_3_authreq.py: using BVCI 23797 21:19:42.297500 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:42.308052 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:42.318606 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:42.329908 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:42.341263 tst encryption: Using 1 x ip_address (candidates: 6) 21:19:42.352409 tst encryption: Using 1 x modem (candidates: 1) 21:19:42.483892 tst register_a5_3_authreq.py:8: start network... 21:19:42.711197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:19:43.227339 run create_hlr_db(pid=16811): Launched 21:19:43.364303 bus /sierra_2: Setting Powered False 21:19:44.429598 run create_hlr_db(pid=16811): Terminated: ok {rc=0} 21:19:44.875450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16813): Launched 21:19:45.187952 run osmo-hlr_10.42.42.2(pid=16814): Launched 21:19:45.307932 run osmo-stp_10.42.42.5: Starting osmo-stp 21:19:45.861707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16816): Launched 21:19:46.240118 run osmo-stp_10.42.42.5(pid=16817): Launched 21:19:46.603309 run osmo-msc_10.42.42.6: Starting osmo-msc 21:19:47.229814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16819): Launched 21:19:47.547897 run osmo-msc_10.42.42.6(pid=16820): Launched 21:19:47.722496 run osmo-stp_10.42.42.5(pid=16817): ERR: Terminated: ERROR {rc=1} [trial-2364↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16817)] 21:19:47.855441 run osmo-stp_10.42.42.5(pid=16817): stdout: | (launched: 2022-12-09_21:19:46.176222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:47.986718 run osmo-stp_10.42.42.5(pid=16817): stderr: | 20221209211946403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211946403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211946403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211946403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211946404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211946404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211946404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:48.116590 run osmo-stp_10.42.42.5(pid=16817): stdout: | (launched: 2022-12-09_21:19:46.176222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:19:48.240765 run osmo-stp_10.42.42.5(pid=16817): stderr: | 20221209211946403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209211946403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209211946403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209211946403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209211946404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209211946404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209211946404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:19:48.389735 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16817): Process ended prematurely: osmo-stp_10.42.42.5(pid=16817) [trial-2364↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16817)] [trial-2364↪encryption↪register_a5_3_authreq.py:8] 21:19:48.398978 tst register_a5_3_authreq.py:8: Test FAILED (6.7 sec) 21:19:48.425613 run osmo-hlr_10.42.42.2(pid=16814): ERR: Terminated: ERROR {rc=237} [trial-2364↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16814)] 21:19:48.473065 run osmo-hlr_10.42.42.2(pid=16814): stdout: | (launched: 2022-12-09_21:19:45.130678) 21:19:48.522176 run osmo-hlr_10.42.42.2(pid=16814): stderr: | 20221209211945309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209211945309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209211945309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209211945309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209211945309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209211945309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209211945322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209211945330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209211945330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209211945330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:19:48.589989 run osmo-msc_10.42.42.6(pid=16820): ERR: Terminated: ERROR {rc=2} [trial-2364↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16820)] 21:19:48.637129 run osmo-msc_10.42.42.6(pid=16820): stdout: | (launched: 2022-12-09_21:19:47.490631) 21:19:48.686011 run osmo-msc_10.42.42.6(pid=16820): stderr: | 20221209211947763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209211947763 DLGLOBAL DEBUG validating counter group 0x7fa131247c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209211947763 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209211947763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209211947763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209211947763 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209211947765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209211947765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209211947766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209211947766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:19:48.735190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16813): Terminating (SIGTERM) 21:19:48.774532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16816): Terminating (SIGTERM) 21:19:48.813800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16819): Terminating (SIGTERM) 21:19:48.853127 --- ParallelTerminationStrategy: PID 16813 died... 21:19:48.871759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16813): Terminated: ok {rc=0} 21:19:48.915382 --- ParallelTerminationStrategy: PID 16816 died... 21:19:48.934144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16816): Terminated: ok {rc=0} 21:19:48.977697 --- ParallelTerminationStrategy: PID 16819 died... 21:19:48.996087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16819): Terminated: ok {rc=0} 21:19:49.079312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 21:19:50.280929 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:19:50.285926 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 21:19:50.303779 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 21:19:50.331704 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 21:19:50.359695 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 21:19:50.379187 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 21:19:50.405505 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 21:19:50.913760 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 21:19:50.918434 tst handover.py:11: TEST_CONFIG: {} 21:19:51.127877 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:19:51.143705 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:19:51.167214 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:19:51.221059 tst handover.py: using MSISDN 7390 21:19:51.336882 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7390', subscriber_id=0} 21:19:51.445914 run srsepc_10.42.42.118: Starting srsepc 21:19:53.301603 run rm-remote-dir(pid=16828): Launched 21:19:53.425704 bus /sierra_2: Setting Powered False 21:19:54.492024 run rm-remote-dir(pid=16828): Terminated: ok {rc=0} 21:19:54.939490 run mk-remote-dir(pid=16829): Launched 21:19:56.120185 run mk-remote-dir(pid=16829): Terminated: ok {rc=0} 21:19:56.410725 run scp-inst-to-remote(pid=16830): Launched 21:19:58.591261 run scp-inst-to-remote(pid=16830): Terminated: ok {rc=0} 21:19:58.930355 run rm-remote-dir(pid=16832): Launched 21:20:00.117113 run rm-remote-dir(pid=16832): Terminated: ok {rc=0} 21:20:00.458287 run mk-remote-dir(pid=16833): Launched 21:20:01.644431 run mk-remote-dir(pid=16833): Terminated: ok {rc=0} 21:20:01.993953 run scp-cfg-to-remote(pid=16837): Launched 21:20:03.259384 run scp-cfg-to-remote(pid=16837): Terminated: ok {rc=0} 21:20:03.567254 run scp-db-to-remote(pid=16839): Launched 21:20:04.759843 run scp-db-to-remote(pid=16839): Terminated: ok {rc=0} 21:20:04.901379 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:05.235795 run patchelf(pid=16841): Launched 21:20:06.426935 run patchelf(pid=16841): Terminated: ok {rc=0} 21:20:06.569181 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:06.905811 run setcap-netadm(pid=16842): Launched 21:20:08.099837 run setcap-netadm(pid=16842): Terminated: ok {rc=0} 21:20:08.449402 run srsepc(pid=16843): Launched 21:20:08.574640 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:09.770285 run rm-remote-dir(pid=16844): Launched 21:20:09.962065 run srsepc(pid=16843): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16843)] 21:20:10.107992 run srsepc(pid=16843): stdout: | (launched: 2022-12-09_21:20:08.387977) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:10.253162 run srsepc(pid=16843): stderr: | (launched: 2022-12-09_21:20:08.437799) | Connection to 10.42.42.116 closed. 21:20:10.398249 run srsepc(pid=16843): stdout: | (launched: 2022-12-09_21:20:08.387977) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:10.538430 run srsepc(pid=16843): stderr: | (launched: 2022-12-09_21:20:08.437799) | Connection to 10.42.42.116 closed. 21:20:10.704189 run rm-remote-dir(pid=16844): Terminating (SIGINT) 21:20:10.895551 run rm-remote-dir(pid=16844): Terminated: ok {rc=0} 21:20:11.033974 tst handover.py:37: ERR: Error: srsepc(pid=16843): Process ended prematurely: srsepc(pid=16843) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16843)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 21:20:11.044764 tst handover.py:37: Test FAILED (20.1 sec) 21:20:11.126660 run scp-back-log(pid=16845): Launched 21:20:12.206765 run scp-back-log(pid=16845): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16845)] 21:20:12.268160 run scp-back-log(pid=16845): stdout: | (launched: 2022-12-09_21:20:11.094016) 21:20:12.330983 run scp-back-log(pid=16845): stderr: | (launched: 2022-12-09_21:20:11.114874) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:12.401228 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16845): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16845)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 21:20:12.446587 tst iperf3_bidir.py:13: Number of physical ue: 1 21:20:12.656221 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:12.698454 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 21:20:12.906549 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:12.922388 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:12.954871 tst iperf3_bidir.py: using MSISDN 7391 21:20:13.067333 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7391', subscriber_id=0} 21:20:13.176176 run srsepc_10.42.42.118: Starting srsepc 21:20:13.814059 run rm-remote-dir(pid=16847): Launched 21:20:14.995079 run rm-remote-dir(pid=16847): Terminated: ok {rc=0} 21:20:15.338605 run mk-remote-dir(pid=16848): Launched 21:20:16.522763 run mk-remote-dir(pid=16848): Terminated: ok {rc=0} 21:20:16.841019 run scp-inst-to-remote(pid=16849): Launched 21:20:19.056885 run scp-inst-to-remote(pid=16849): Terminated: ok {rc=0} 21:20:19.419164 run rm-remote-dir(pid=16851): Launched 21:20:20.615201 run rm-remote-dir(pid=16851): Terminated: ok {rc=0} 21:20:20.979213 run mk-remote-dir(pid=16852): Launched 21:20:22.174475 run mk-remote-dir(pid=16852): Terminated: ok {rc=0} 21:20:22.483935 run scp-cfg-to-remote(pid=16853): Launched 21:20:23.676849 run scp-cfg-to-remote(pid=16853): Terminated: ok {rc=0} 21:20:23.985430 run scp-db-to-remote(pid=16855): Launched 21:20:25.178511 run scp-db-to-remote(pid=16855): Terminated: ok {rc=0} 21:20:25.320851 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:25.657067 run patchelf(pid=16857): Launched 21:20:26.850463 run patchelf(pid=16857): Terminated: ok {rc=0} 21:20:26.992275 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:27.327601 run setcap-netadm(pid=16858): Launched 21:20:28.521509 run setcap-netadm(pid=16858): Terminated: ok {rc=0} 21:20:28.877137 run srsepc(pid=16859): Launched 21:20:29.002341 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:30.197154 run rm-remote-dir(pid=16860): Launched 21:20:30.389365 run srsepc(pid=16859): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16859)] 21:20:30.536691 run srsepc(pid=16859): stdout: | (launched: 2022-12-09_21:20:28.815345) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:30.682726 run srsepc(pid=16859): stderr: | (launched: 2022-12-09_21:20:28.865375) | Connection to 10.42.42.116 closed. 21:20:30.829686 run srsepc(pid=16859): stdout: | (launched: 2022-12-09_21:20:28.815345) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:30.985924 run srsepc(pid=16859): stderr: | (launched: 2022-12-09_21:20:28.865375) | Connection to 10.42.42.116 closed. 21:20:31.151074 run rm-remote-dir(pid=16860): Terminating (SIGINT) 21:20:31.337485 run rm-remote-dir(pid=16860): Terminated: ok {rc=0} 21:20:31.474133 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=16859): Process ended prematurely: srsepc(pid=16859) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16859)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 21:20:31.485614 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 21:20:31.575030 run scp-back-log(pid=16861): Launched 21:20:32.687635 run scp-back-log(pid=16861): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16861)] 21:20:32.751672 run scp-back-log(pid=16861): stdout: | (launched: 2022-12-09_21:20:31.537789) 21:20:32.817188 run scp-back-log(pid=16861): stderr: | (launched: 2022-12-09_21:20:31.558123) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:32.891222 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16861): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16861)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 21:20:32.938442 tst iperf3_dl.py:13: Number of physical ue: 1 21:20:33.163040 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:33.213393 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 21:20:33.437019 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:33.453417 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:33.485281 tst iperf3_dl.py: using MSISDN 7392 21:20:33.606299 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7392', subscriber_id=0} 21:20:33.723020 run srsepc_10.42.42.118: Starting srsepc 21:20:34.402933 run rm-remote-dir(pid=16863): Launched 21:20:35.597308 run rm-remote-dir(pid=16863): Terminated: ok {rc=0} 21:20:35.960434 run mk-remote-dir(pid=16864): Launched 21:20:37.155675 run mk-remote-dir(pid=16864): Terminated: ok {rc=0} 21:20:37.465605 run scp-inst-to-remote(pid=16865): Launched 21:20:39.656279 run scp-inst-to-remote(pid=16865): Terminated: ok {rc=0} 21:20:39.995582 run rm-remote-dir(pid=16867): Launched 21:20:41.177181 run rm-remote-dir(pid=16867): Terminated: ok {rc=0} 21:20:41.517737 run mk-remote-dir(pid=16869): Launched 21:20:42.699346 run mk-remote-dir(pid=16869): Terminated: ok {rc=0} 21:20:42.989958 run scp-cfg-to-remote(pid=16870): Launched 21:20:44.167558 run scp-cfg-to-remote(pid=16870): Terminated: ok {rc=0} 21:20:44.456610 run scp-db-to-remote(pid=16872): Launched 21:20:45.635827 run scp-db-to-remote(pid=16872): Terminated: ok {rc=0} 21:20:45.769100 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:20:46.116874 run patchelf(pid=16874): Launched 21:20:47.370931 run patchelf(pid=16874): Terminated: ok {rc=0} 21:20:47.512935 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:20:47.847600 run setcap-netadm(pid=16875): Launched 21:20:49.040106 run setcap-netadm(pid=16875): Terminated: ok {rc=0} 21:20:49.390527 run srsepc(pid=16876): Launched 21:20:49.518448 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:20:50.718314 run rm-remote-dir(pid=16877): Launched 21:20:50.910061 run srsepc(pid=16876): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16876)] 21:20:51.056267 run srsepc(pid=16876): stdout: | (launched: 2022-12-09_21:20:49.328908) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:51.201376 run srsepc(pid=16876): stderr: | (launched: 2022-12-09_21:20:49.378844) | Connection to 10.42.42.116 closed. 21:20:51.346484 run srsepc(pid=16876): stdout: | (launched: 2022-12-09_21:20:49.328908) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:20:51.486057 run srsepc(pid=16876): stderr: | (launched: 2022-12-09_21:20:49.378844) | Connection to 10.42.42.116 closed. 21:20:51.651947 run rm-remote-dir(pid=16877): Terminating (SIGINT) 21:20:51.842995 run rm-remote-dir(pid=16877): Terminated: ok {rc=0} 21:20:51.981752 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=16876): Process ended prematurely: srsepc(pid=16876) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16876)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 21:20:51.992719 tst iperf3_dl.py:42: Test FAILED (19.0 sec) 21:20:52.074239 run scp-back-log(pid=16878): Launched 21:20:53.154832 run scp-back-log(pid=16878): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16878)] 21:20:53.218046 run scp-back-log(pid=16878): stdout: | (launched: 2022-12-09_21:20:52.041596) 21:20:53.283023 run scp-back-log(pid=16878): stderr: | (launched: 2022-12-09_21:20:52.062162) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:20:53.355947 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16878): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16878)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 21:20:53.403283 tst iperf3_ul.py:13: Number of physical ue: 1 21:20:53.627961 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:20:53.670583 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 21:20:53.893121 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:20:53.909414 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:20:53.942995 tst iperf3_ul.py: using MSISDN 7393 21:20:54.063205 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7393', subscriber_id=0} 21:20:54.179986 run srsepc_10.42.42.118: Starting srsepc 21:20:54.861005 run rm-remote-dir(pid=16880): Launched 21:20:56.055392 run rm-remote-dir(pid=16880): Terminated: ok {rc=0} 21:20:56.420103 run mk-remote-dir(pid=16881): Launched 21:20:57.616810 run mk-remote-dir(pid=16881): Terminated: ok {rc=0} 21:20:57.928090 run scp-inst-to-remote(pid=16882): Launched 21:21:00.122259 run scp-inst-to-remote(pid=16882): Terminated: ok {rc=0} 21:21:00.484470 run rm-remote-dir(pid=16884): Launched 21:21:01.708059 run rm-remote-dir(pid=16884): Terminated: ok {rc=0} 21:21:02.131664 run mk-remote-dir(pid=16885): Launched 21:21:03.378860 run mk-remote-dir(pid=16885): Terminated: ok {rc=0} 21:21:03.689944 run scp-cfg-to-remote(pid=16886): Launched 21:21:04.882352 run scp-cfg-to-remote(pid=16886): Terminated: ok {rc=0} 21:21:05.190208 run scp-db-to-remote(pid=16888): Launched 21:21:06.382038 run scp-db-to-remote(pid=16888): Terminated: ok {rc=0} 21:21:06.524430 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:06.861896 run patchelf(pid=16890): Launched 21:21:08.053347 run patchelf(pid=16890): Terminated: ok {rc=0} 21:21:08.195937 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:08.532760 run setcap-netadm(pid=16891): Launched 21:21:09.727483 run setcap-netadm(pid=16891): Terminated: ok {rc=0} 21:21:10.080079 run srsepc(pid=16892): Launched 21:21:10.205942 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:11.410288 run rm-remote-dir(pid=16893): Launched 21:21:11.603883 run srsepc(pid=16892): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16892)] 21:21:11.750381 run srsepc(pid=16892): stdout: | (launched: 2022-12-09_21:21:10.018589) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:11.896794 run srsepc(pid=16892): stderr: | (launched: 2022-12-09_21:21:10.068371) | Connection to 10.42.42.116 closed. 21:21:12.043319 run srsepc(pid=16892): stdout: | (launched: 2022-12-09_21:21:10.018589) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:12.184012 run srsepc(pid=16892): stderr: | (launched: 2022-12-09_21:21:10.068371) | Connection to 10.42.42.116 closed. 21:21:12.350844 run rm-remote-dir(pid=16893): Terminating (SIGINT) 21:21:12.542392 run rm-remote-dir(pid=16893): Terminated: ok {rc=0} 21:21:12.681219 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=16892): Process ended prematurely: srsepc(pid=16892) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16892)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 21:21:12.692014 tst iperf3_ul.py:42: Test FAILED (19.3 sec) 21:21:12.772872 run scp-back-log(pid=16894): Launched 21:21:13.854875 run scp-back-log(pid=16894): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16894)] 21:21:13.918922 run scp-back-log(pid=16894): stdout: | (launched: 2022-12-09_21:21:12.740534) 21:21:13.984024 run scp-back-log(pid=16894): stderr: | (launched: 2022-12-09_21:21:12.761213) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:14.057330 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16894): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16894)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 21:21:14.105466 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:21:14.122898 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:21:14.146748 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:21:14.200258 tst ping.py: using MSISDN 7394 21:21:14.317610 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7394', subscriber_id=0} 21:21:14.427687 run srsepc_10.42.42.118: Starting srsepc 21:21:15.069305 run rm-remote-dir(pid=16896): Launched 21:21:16.271192 run rm-remote-dir(pid=16896): Terminated: ok {rc=0} 21:21:16.690173 run mk-remote-dir(pid=16897): Launched 21:21:17.943861 run mk-remote-dir(pid=16897): Terminated: ok {rc=0} 21:21:18.234381 run scp-inst-to-remote(pid=16898): Launched 21:21:20.413927 run scp-inst-to-remote(pid=16898): Terminated: ok {rc=0} 21:21:20.753427 run rm-remote-dir(pid=16900): Launched 21:21:21.934844 run rm-remote-dir(pid=16900): Terminated: ok {rc=0} 21:21:22.276007 run mk-remote-dir(pid=16901): Launched 21:21:23.457418 run mk-remote-dir(pid=16901): Terminated: ok {rc=0} 21:21:23.748630 run scp-cfg-to-remote(pid=16902): Launched 21:21:24.927369 run scp-cfg-to-remote(pid=16902): Terminated: ok {rc=0} 21:21:25.216889 run scp-db-to-remote(pid=16904): Launched 21:21:26.396181 run scp-db-to-remote(pid=16904): Terminated: ok {rc=0} 21:21:26.529082 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:26.843088 run patchelf(pid=16906): Launched 21:21:28.021839 run patchelf(pid=16906): Terminated: ok {rc=0} 21:21:28.154398 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:28.468425 run setcap-netadm(pid=16907): Launched 21:21:29.650807 run setcap-netadm(pid=16907): Terminated: ok {rc=0} 21:21:30.001500 run srsepc(pid=16908): Launched 21:21:30.126999 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:31.379876 run rm-remote-dir(pid=16909): Launched 21:21:31.660308 run srsepc(pid=16908): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16908)] 21:21:31.880732 run srsepc(pid=16908): stdout: | (launched: 2022-12-09_21:21:29.939999) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:32.063170 run srsepc(pid=16908): stderr: | (launched: 2022-12-09_21:21:29.989937) | Connection to 10.42.42.116 closed. 21:21:32.216685 run srsepc(pid=16908): stdout: | (launched: 2022-12-09_21:21:29.939999) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:32.362004 run srsepc(pid=16908): stderr: | (launched: 2022-12-09_21:21:29.989937) | Connection to 10.42.42.116 closed. 21:21:32.528157 run rm-remote-dir(pid=16909): Terminating (SIGINT) 21:21:32.719997 run rm-remote-dir(pid=16909): Terminated: ok {rc=0} 21:21:32.858567 tst ping.py:16: ERR: Error: srsepc(pid=16908): Process ended prematurely: srsepc(pid=16908) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16908)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 21:21:32.869629 tst ping.py:16: Test FAILED (18.8 sec) 21:21:32.951842 run scp-back-log(pid=16910): Launched 21:21:34.032086 run scp-back-log(pid=16910): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16910)] 21:21:34.095431 run scp-back-log(pid=16910): stdout: | (launched: 2022-12-09_21:21:32.918839) 21:21:34.160456 run scp-back-log(pid=16910): stderr: | (launched: 2022-12-09_21:21:32.939516) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:34.233111 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16910): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16910)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 21:21:34.280611 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:21:34.298102 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:21:34.321524 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:21:34.372919 tst rrc_idle_mo_ping.py: using MSISDN 7395 21:21:34.496132 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7395', subscriber_id=0} 21:21:34.613204 run srsepc_10.42.42.118: Starting srsepc 21:21:35.291683 run rm-remote-dir(pid=16912): Launched 21:21:36.488220 run rm-remote-dir(pid=16912): Terminated: ok {rc=0} 21:21:36.851529 run mk-remote-dir(pid=16913): Launched 21:21:38.044570 run mk-remote-dir(pid=16913): Terminated: ok {rc=0} 21:21:38.353870 run scp-inst-to-remote(pid=16914): Launched 21:21:40.548492 run scp-inst-to-remote(pid=16914): Terminated: ok {rc=0} 21:21:40.909675 run rm-remote-dir(pid=16916): Launched 21:21:42.102798 run rm-remote-dir(pid=16916): Terminated: ok {rc=0} 21:21:42.466066 run mk-remote-dir(pid=16917): Launched 21:21:43.662151 run mk-remote-dir(pid=16917): Terminated: ok {rc=0} 21:21:43.971132 run scp-cfg-to-remote(pid=16918): Launched 21:21:45.161934 run scp-cfg-to-remote(pid=16918): Terminated: ok {rc=0} 21:21:45.469527 run scp-db-to-remote(pid=16920): Launched 21:21:46.657187 run scp-db-to-remote(pid=16920): Terminated: ok {rc=0} 21:21:46.795487 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:21:47.118583 run patchelf(pid=16922): Launched 21:21:48.342583 run patchelf(pid=16922): Terminated: ok {rc=0} 21:21:48.484573 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:21:48.819270 run setcap-netadm(pid=16923): Launched 21:21:50.012925 run setcap-netadm(pid=16923): Terminated: ok {rc=0} 21:21:50.364395 run srsepc(pid=16924): Launched 21:21:50.489111 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:21:51.622332 run rm-remote-dir(pid=16925): Launched 21:21:51.799991 run srsepc(pid=16924): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16924)] 21:21:51.935668 run srsepc(pid=16924): stdout: | (launched: 2022-12-09_21:21:50.302900) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:52.072116 run srsepc(pid=16924): stderr: | (launched: 2022-12-09_21:21:50.352740) | Connection to 10.42.42.116 closed. 21:21:52.208430 run srsepc(pid=16924): stdout: | (launched: 2022-12-09_21:21:50.302900) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:21:52.339026 run srsepc(pid=16924): stderr: | (launched: 2022-12-09_21:21:50.352740) | Connection to 10.42.42.116 closed. 21:21:52.493846 run rm-remote-dir(pid=16925): Terminating (SIGINT) 21:21:52.673356 run rm-remote-dir(pid=16925): Terminated: ok {rc=0} 21:21:52.803238 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=16924): Process ended prematurely: srsepc(pid=16924) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16924)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 21:21:52.813414 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 21:21:52.890545 run scp-back-log(pid=16926): Launched 21:21:53.966276 run scp-back-log(pid=16926): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16926)] 21:21:54.026213 run scp-back-log(pid=16926): stdout: | (launched: 2022-12-09_21:21:52.859817) 21:21:54.087711 run scp-back-log(pid=16926): stderr: | (launched: 2022-12-09_21:21:52.879358) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:21:54.156998 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16926): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16926)]') ---------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 21:21:54.202107 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 21:21:54.218647 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 21:21:54.241686 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 21:21:54.295276 tst rrc_idle_mt_ping.py: using MSISDN 7396 21:21:54.412085 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7396', subscriber_id=0} 21:21:54.521330 run srsepc_10.42.42.118: Starting srsepc 21:21:55.155595 run rm-remote-dir(pid=16928): Launched 21:21:56.336734 run rm-remote-dir(pid=16928): Terminated: ok {rc=0} 21:21:56.676325 run mk-remote-dir(pid=16929): Launched 21:21:57.855774 run mk-remote-dir(pid=16929): Terminated: ok {rc=0} 21:21:58.145013 run scp-inst-to-remote(pid=16930): Launched 21:22:00.324231 run scp-inst-to-remote(pid=16930): Terminated: ok {rc=0} 21:22:00.662330 run rm-remote-dir(pid=16932): Launched 21:22:01.843757 run rm-remote-dir(pid=16932): Terminated: ok {rc=0} 21:22:02.191807 run mk-remote-dir(pid=16933): Launched 21:22:03.391660 run mk-remote-dir(pid=16933): Terminated: ok {rc=0} 21:22:03.682060 run scp-cfg-to-remote(pid=16934): Launched 21:22:04.859449 run scp-cfg-to-remote(pid=16934): Terminated: ok {rc=0} 21:22:05.146474 run scp-db-to-remote(pid=16936): Launched 21:22:06.324154 run scp-db-to-remote(pid=16936): Terminated: ok {rc=0} 21:22:06.456685 run srsepc_10.42.42.118: Setting RPATH for srsepc 21:22:06.769694 run patchelf(pid=16938): Launched 21:22:07.947216 run patchelf(pid=16938): Terminated: ok {rc=0} 21:22:08.080126 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 21:22:08.393393 run setcap-netadm(pid=16939): Launched 21:22:09.571065 run setcap-netadm(pid=16939): Terminated: ok {rc=0} 21:22:09.899121 run srsepc(pid=16940): Launched 21:22:10.014099 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 21:22:11.136790 run rm-remote-dir(pid=16941): Launched 21:22:11.315298 run srsepc(pid=16940): ERR: Terminated: ERROR {rc=127} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16940)] 21:22:11.451731 run srsepc(pid=16940): stdout: | (launched: 2022-12-09_21:22:09.841901) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:22:11.589440 run srsepc(pid=16940): stderr: | (launched: 2022-12-09_21:22:09.887871) | Connection to 10.42.42.116 closed. 21:22:11.726862 run srsepc(pid=16940): stdout: | (launched: 2022-12-09_21:22:09.841901) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 21:22:11.858134 run srsepc(pid=16940): stderr: | (launched: 2022-12-09_21:22:09.887871) | Connection to 10.42.42.116 closed. 21:22:12.013640 run rm-remote-dir(pid=16941): Terminating (SIGINT) 21:22:12.193643 run rm-remote-dir(pid=16941): Terminated: ok {rc=0} 21:22:12.323957 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=16940): Process ended prematurely: srsepc(pid=16940) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16940)] [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 21:22:12.334242 tst rrc_idle_mt_ping.py:16: Test FAILED (18.1 sec) 21:22:12.412088 run scp-back-log(pid=16943): Launched 21:22:13.488386 run scp-back-log(pid=16943): ERR: Terminated: ERROR {rc=1} [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16943)] 21:22:13.548738 run scp-back-log(pid=16943): stdout: | (launched: 2022-12-09_21:22:12.380828) 21:22:13.610239 run scp-back-log(pid=16943): stderr: | (launched: 2022-12-09_21:22:12.400466) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 21:22:13.680297 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16943): launch_sync(): local process exited with status 1 [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16943)]') --------------------------------------------------------------------- trial-2364 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 21:22:13.811475 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:13.816600 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 21:22:13.857749 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 21:22:13.884282 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 21:22:13.935437 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 21:22:13.979861 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 21:22:14.007662 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 21:22:14.557535 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 21:22:14.563411 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:14.574769 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:22:14.613326 tst handover.py: using LAC 23797 21:22:14.742970 tst handover.py: using RAC 82 21:22:14.869925 tst handover.py: using CellId 23797 21:22:14.998525 tst handover.py: using BVCI 23798 21:22:15.117640 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 21:22:15.152043 tst handover.py: using LAC 23798 21:22:15.278116 tst handover.py: using RAC 83 21:22:15.408129 tst handover.py: using CellId 23798 21:22:15.527165 tst handover.py: using BVCI 23799 21:22:15.640523 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:15.651521 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:15.662650 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:15.674183 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:15.685291 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 21:22:15.696007 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:22:15.815531 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 21:22:15.959543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:16.496620 run create_hlr_db(pid=16949): Launched 21:22:17.763707 run create_hlr_db(pid=16949): Terminated: ok {rc=0} 21:22:18.108577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Launched 21:22:18.435614 run osmo-hlr_10.42.42.2(pid=16952): Launched 21:22:18.561299 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:19.127589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Launched 21:22:19.455521 run osmo-stp_10.42.42.5(pid=16955): Launched 21:22:19.581775 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:20.175528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16957): Launched 21:22:20.505071 run osmo-msc_10.42.42.6(pid=16958): Launched 21:22:20.687465 run osmo-stp_10.42.42.5(pid=16955): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] 21:22:20.824578 run osmo-stp_10.42.42.5(pid=16955): stdout: | (launched: 2022-12-09_21:22:19.395048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:20.961956 run osmo-stp_10.42.42.5(pid=16955): stderr: | 20221209212219590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212219590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212219590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212219590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212219591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212219591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212219591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:21.098370 run osmo-stp_10.42.42.5(pid=16955): stdout: | (launched: 2022-12-09_21:22:19.395048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:21.228578 run osmo-stp_10.42.42.5(pid=16955): stderr: | 20221209212219590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212219590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212219590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212219590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212219591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212219591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212219591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:21.384353 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16955): Process ended prematurely: osmo-stp_10.42.42.5(pid=16955) [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 21:22:21.393514 tst handover.py:18: Test FAILED (6.8 sec) 21:22:21.421049 run osmo-hlr_10.42.42.2(pid=16952): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16952)] 21:22:21.471164 run osmo-hlr_10.42.42.2(pid=16952): stdout: | (launched: 2022-12-09_21:22:18.375283) 21:22:21.522738 run osmo-hlr_10.42.42.2(pid=16952): stderr: | 20221209212218574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212218574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212218574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212218574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212218574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212218575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212218590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212218600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212218600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212218600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:21.595491 run osmo-msc_10.42.42.6(pid=16958): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16958)] 21:22:21.645643 run osmo-msc_10.42.42.6(pid=16958): stdout: | (launched: 2022-12-09_21:22:20.443991) 21:22:21.697293 run osmo-msc_10.42.42.6(pid=16958): stderr: | 20221209212220765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212220765 DLGLOBAL DEBUG validating counter group 0x7f681b719c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212220765 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212220765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212220765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212220766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212220767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212220768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212220768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212220768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:21.749540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Terminating (SIGTERM) 21:22:21.791092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Terminating (SIGTERM) 21:22:21.832678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16957): Terminating (SIGTERM) 21:22:21.874490 --- ParallelTerminationStrategy: PID 16951 died... 21:22:21.894383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Terminated: ok {rc=0} 21:22:21.940440 --- ParallelTerminationStrategy: PID 16954 died... 21:22:21.959864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Terminated: ok {rc=0} 21:22:22.005865 --- ParallelTerminationStrategy: PID 16957 died... 21:22:22.025474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16957): Terminated: ok {rc=0} 21:22:22.113584 bus /sierra_3: Setting Powered False 21:22:23.212676 bus /sierra_3: Setting Powered False 21:22:24.330739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 21:22:25.572752 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:25.577854 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:22:25.618449 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:22:25.645087 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:22:25.698423 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:22:25.738643 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:22:25.765157 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:22:26.316390 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 21:22:26.321807 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:26.332474 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:22:26.371449 tst handover.py: using LAC 23799 21:22:26.493686 tst handover.py: using RAC 84 21:22:26.616821 tst handover.py: using CellId 23799 21:22:26.742693 tst handover.py: using BVCI 23800 21:22:26.863922 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 21:22:26.897250 tst handover.py: using LAC 23800 21:22:27.023676 tst handover.py: using RAC 85 21:22:27.151989 tst handover.py: using CellId 23800 21:22:27.278716 tst handover.py: using BVCI 23801 21:22:27.399729 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:27.410972 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:27.422148 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:27.433739 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:27.445403 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:22:27.456882 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:22:27.575262 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 21:22:27.691578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:28.140749 run create_hlr_db(pid=16963): Launched 21:22:28.258068 bus /sierra_2: Setting Powered False 21:22:29.318378 run create_hlr_db(pid=16963): Terminated: ok {rc=0} 21:22:29.741128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16965): Launched 21:22:30.070678 run osmo-hlr_10.42.42.2(pid=16966): Launched 21:22:30.198085 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:30.740353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16968): Launched 21:22:31.119938 run osmo-stp_10.42.42.5(pid=16969): Launched 21:22:31.366823 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:31.984461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16971): Launched 21:22:32.334976 run osmo-msc_10.42.42.6(pid=16972): Launched 21:22:32.519021 run osmo-stp_10.42.42.5(pid=16969): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16969)] 21:22:32.658017 run osmo-stp_10.42.42.5(pid=16969): stdout: | (launched: 2022-12-09_21:22:31.056624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:32.796684 run osmo-stp_10.42.42.5(pid=16969): stderr: | 20221209212231354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212231354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212231354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212231355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212231357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212231357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212231357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:32.934254 run osmo-stp_10.42.42.5(pid=16969): stdout: | (launched: 2022-12-09_21:22:31.056624) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:33.065695 run osmo-stp_10.42.42.5(pid=16969): stderr: | 20221209212231354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212231354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212231354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212231355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212231357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212231357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212231357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:33.222635 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16969): Process ended prematurely: osmo-stp_10.42.42.5(pid=16969) [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16969)] [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 21:22:33.231617 tst handover.py:18: Test FAILED (6.9 sec) 21:22:33.258883 run osmo-hlr_10.42.42.2(pid=16966): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16966)] 21:22:33.308657 run osmo-hlr_10.42.42.2(pid=16966): stdout: | (launched: 2022-12-09_21:22:30.010061) 21:22:33.360199 run osmo-hlr_10.42.42.2(pid=16966): stderr: | 20221209212230209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212230209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212230209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212230209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212230209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212230209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212230221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212230230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212230230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212230230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:33.431959 run osmo-msc_10.42.42.6(pid=16972): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16972)] 21:22:33.481627 run osmo-msc_10.42.42.6(pid=16972): stdout: | (launched: 2022-12-09_21:22:32.268898) 21:22:33.533075 run osmo-msc_10.42.42.6(pid=16972): stderr: | 20221209212232610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212232610 DLGLOBAL DEBUG validating counter group 0x7f3fddfa6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212232610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212232610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212232610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212232610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212232612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212232613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212232613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212232613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:33.585209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16965): Terminating (SIGTERM) 21:22:33.626884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16968): Terminating (SIGTERM) 21:22:33.668497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16971): Terminating (SIGTERM) 21:22:33.710355 --- ParallelTerminationStrategy: PID 16965 died... 21:22:33.730134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16965): Terminated: ok {rc=0} 21:22:33.775830 --- ParallelTerminationStrategy: PID 16968 died... 21:22:33.795175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16968): Terminated: ok {rc=0} 21:22:33.841405 --- ParallelTerminationStrategy: PID 16971 died... 21:22:33.860715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16971): Terminated: ok {rc=0} 21:22:33.949031 bus /sierra_3: Setting Powered False 21:22:35.048228 bus /sierra_3: Setting Powered False 21:22:36.164257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 21:22:37.409517 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:37.415071 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:22:37.469347 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:22:37.496508 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:22:37.550961 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:22:37.605906 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:22:37.633025 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:22:38.184129 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 21:22:38.190546 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:38.202003 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:22:38.239545 tst handover.py: using LAC 23801 21:22:38.364046 tst handover.py: using RAC 86 21:22:38.485105 tst handover.py: using CellId 23801 21:22:38.613197 tst handover.py: using BVCI 23802 21:22:38.732101 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:22:38.780283 tst handover.py: using LAC 23802 21:22:38.907074 tst handover.py: using RAC 87 21:22:39.033708 tst handover.py: using CellId 23802 21:22:39.167469 tst handover.py: using BVCI 23803 21:22:39.287267 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:39.298648 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:39.309803 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:39.320860 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:39.332075 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:22:39.343239 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:22:39.459628 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:22:39.580607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:40.062485 run create_hlr_db(pid=16979): Launched 21:22:40.197485 bus /sierra_2: Setting Powered False 21:22:41.262444 run create_hlr_db(pid=16979): Terminated: ok {rc=0} 21:22:41.690536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16981): Launched 21:22:42.019289 run osmo-hlr_10.42.42.2(pid=16982): Launched 21:22:42.144329 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:42.683964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16984): Launched 21:22:43.010670 run osmo-stp_10.42.42.5(pid=16985): Launched 21:22:43.137211 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:43.702432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16987): Launched 21:22:44.031178 run osmo-msc_10.42.42.6(pid=16988): Launched 21:22:44.214559 run osmo-stp_10.42.42.5(pid=16985): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] 21:22:44.351981 run osmo-stp_10.42.42.5(pid=16985): stdout: | (launched: 2022-12-09_21:22:42.950432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:44.489946 run osmo-stp_10.42.42.5(pid=16985): stderr: | 20221209212243143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212243143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212243143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212243143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212243146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212243146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212243146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:44.626911 run osmo-stp_10.42.42.5(pid=16985): stdout: | (launched: 2022-12-09_21:22:42.950432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:44.757314 run osmo-stp_10.42.42.5(pid=16985): stderr: | 20221209212243143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212243143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212243143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212243143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212243146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212243146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212243146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:44.913086 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16985): Process ended prematurely: osmo-stp_10.42.42.5(pid=16985) [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 21:22:44.922105 tst handover.py:18: Test FAILED (6.7 sec) 21:22:44.949322 run osmo-hlr_10.42.42.2(pid=16982): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16982)] 21:22:44.999040 run osmo-hlr_10.42.42.2(pid=16982): stdout: | (launched: 2022-12-09_21:22:41.958662) 21:22:45.050396 run osmo-hlr_10.42.42.2(pid=16982): stderr: | 20221209212242159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212242159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212242160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212242160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212242160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212242160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212242172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212242181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212242181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212242181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:45.122200 run osmo-msc_10.42.42.6(pid=16988): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16988)] 21:22:45.171802 run osmo-msc_10.42.42.6(pid=16988): stdout: | (launched: 2022-12-09_21:22:43.970875) 21:22:45.222938 run osmo-msc_10.42.42.6(pid=16988): stderr: | 20221209212244290 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212244290 DLGLOBAL DEBUG validating counter group 0x7fa9cd79ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212244291 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212244291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212244291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212244291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212244293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212244293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212244293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212244293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:45.275040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16981): Terminating (SIGTERM) 21:22:45.316381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16984): Terminating (SIGTERM) 21:22:45.357651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16987): Terminating (SIGTERM) 21:22:45.398923 --- ParallelTerminationStrategy: PID 16981 died... 21:22:45.418693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16981): Terminated: ok {rc=0} 21:22:45.464375 --- ParallelTerminationStrategy: PID 16984 died... 21:22:45.483515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16984): Terminated: ok {rc=0} 21:22:45.529305 --- ParallelTerminationStrategy: PID 16987 died... 21:22:45.548618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16987): Terminated: ok {rc=0} 21:22:45.636318 bus /sierra_3: Setting Powered False 21:22:46.735655 bus /sierra_3: Setting Powered False 21:22:47.852589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:22:49.118891 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:22:49.124751 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:22:49.175392 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:22:49.202722 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:22:49.254693 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:22:49.305187 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:22:49.332289 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:22:49.886761 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:22:49.892133 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:49.903572 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:22:49.941844 tst handover.py: using LAC 23803 21:22:50.070103 tst handover.py: using RAC 88 21:22:50.197416 tst handover.py: using CellId 23803 21:22:50.327604 tst handover.py: using BVCI 23804 21:22:50.439649 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:22:50.483982 tst handover.py: using LAC 23804 21:22:50.606419 tst handover.py: using RAC 89 21:22:50.727939 tst handover.py: using CellId 23804 21:22:50.848910 tst handover.py: using BVCI 23805 21:22:50.960836 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:50.971940 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:50.982719 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:50.993971 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:51.005143 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:22:51.016142 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:22:51.136630 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:22:51.256069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:22:51.736061 run create_hlr_db(pid=16993): Launched 21:22:51.868027 bus /sierra_2: Setting Powered False 21:22:52.932575 run create_hlr_db(pid=16993): Terminated: ok {rc=0} 21:22:53.343660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16995): Launched 21:22:53.651457 run osmo-hlr_10.42.42.2(pid=16996): Launched 21:22:53.768733 run osmo-stp_10.42.42.5: Starting osmo-stp 21:22:54.286496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16998): Launched 21:22:54.593558 run osmo-stp_10.42.42.5(pid=16999): Launched 21:22:54.711369 run osmo-msc_10.42.42.6: Starting osmo-msc 21:22:55.244241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17001): Launched 21:22:55.552009 run osmo-msc_10.42.42.6(pid=17002): Launched 21:22:55.723809 run osmo-stp_10.42.42.5(pid=16999): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16999)] 21:22:55.917406 run osmo-stp_10.42.42.5(pid=16999): stdout: | (launched: 2022-12-09_21:22:54.536633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:56.045413 run osmo-stp_10.42.42.5(pid=16999): stderr: | 20221209212254710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212254710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212254710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212254711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212254711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212254711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212254711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:56.173300 run osmo-stp_10.42.42.5(pid=16999): stdout: | (launched: 2022-12-09_21:22:54.536633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:22:56.295373 run osmo-stp_10.42.42.5(pid=16999): stderr: | 20221209212254710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212254710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212254710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212254711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212254711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212254711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212254711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:22:56.441233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16999): Process ended prematurely: osmo-stp_10.42.42.5(pid=16999) [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16999)] [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 21:22:56.449592 tst handover.py:18: Test FAILED (6.6 sec) 21:22:56.475729 run osmo-hlr_10.42.42.2(pid=16996): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16996)] 21:22:56.523463 run osmo-hlr_10.42.42.2(pid=16996): stdout: | (launched: 2022-12-09_21:22:53.594260) 21:22:56.572898 run osmo-hlr_10.42.42.2(pid=16996): stderr: | 20221209212253769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212253770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212253770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212253770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212253770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212253770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212253782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212253793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212253793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212253793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:22:56.641373 run osmo-msc_10.42.42.6(pid=17002): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17002)] 21:22:56.688764 run osmo-msc_10.42.42.6(pid=17002): stdout: | (launched: 2022-12-09_21:22:55.494954) 21:22:56.737525 run osmo-msc_10.42.42.6(pid=17002): stderr: | 20221209212255764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212255764 DLGLOBAL DEBUG validating counter group 0x7f95268e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212255764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212255764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212255764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212255765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212255766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212255767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212255767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212255767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:22:56.786477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16995): Terminating (SIGTERM) 21:22:56.825829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16998): Terminating (SIGTERM) 21:22:56.865167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17001): Terminating (SIGTERM) 21:22:56.904638 --- ParallelTerminationStrategy: PID 16995 died... 21:22:56.923571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16995): Terminated: ok {rc=0} 21:22:56.967178 --- ParallelTerminationStrategy: PID 16998 died... 21:22:56.985558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16998): Terminated: ok {rc=0} 21:22:57.029257 --- ParallelTerminationStrategy: PID 17001 died... 21:22:57.047548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17001): Terminated: ok {rc=0} 21:22:57.130946 bus /sierra_3: Setting Powered False 21:22:58.227978 bus /sierra_3: Setting Powered False 21:22:59.344649 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:23:00.597523 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:00.602495 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:23:00.656399 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:23:00.682829 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:23:00.734859 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:23:00.788094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:23:00.814430 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:23:01.370701 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:23:01.377030 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:01.389123 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:23:01.429678 tst handover.py: using LAC 23805 21:23:01.562138 tst handover.py: using RAC 90 21:23:01.686187 tst handover.py: using CellId 23805 21:23:01.842451 tst handover.py: using BVCI 23806 21:23:01.959565 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:23:02.017209 tst handover.py: using LAC 23806 21:23:02.146458 tst handover.py: using RAC 91 21:23:02.276621 tst handover.py: using CellId 23806 21:23:02.409265 tst handover.py: using BVCI 23807 21:23:02.525282 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:02.537423 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:02.549534 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:02.563507 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:02.578029 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:23:02.591046 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:23:02.717673 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:23:02.844165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:03.334670 run create_hlr_db(pid=17018): Launched 21:23:03.499391 bus /sierra_2: Setting Powered False 21:23:04.566926 run create_hlr_db(pid=17018): Terminated: ok {rc=0} 21:23:05.008149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17020): Launched 21:23:05.356210 run osmo-hlr_10.42.42.2(pid=17021): Launched 21:23:05.518671 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:06.219454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Launched 21:23:06.551324 run osmo-stp_10.42.42.5(pid=17026): Launched 21:23:06.788867 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:07.474307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Launched 21:23:07.801184 run osmo-msc_10.42.42.6(pid=17029): Launched 21:23:08.151769 run osmo-stp_10.42.42.5(pid=17026): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] 21:23:08.522652 run osmo-stp_10.42.42.5(pid=17026): stdout: | (launched: 2022-12-09_21:23:06.490332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:08.793477 run osmo-stp_10.42.42.5(pid=17026): stderr: | 20221209212306810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212306810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212306811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212306811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212306811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212306812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212306812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:08.925996 run osmo-stp_10.42.42.5(pid=17026): stdout: | (launched: 2022-12-09_21:23:06.490332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:09.084637 run osmo-stp_10.42.42.5(pid=17026): stderr: | 20221209212306810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212306810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212306811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212306811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212306811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212306812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212306812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:09.262552 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17026): Process ended prematurely: osmo-stp_10.42.42.5(pid=17026) [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 21:23:09.272152 tst handover.py:18: Test FAILED (7.9 sec) 21:23:09.302230 run osmo-hlr_10.42.42.2(pid=17021): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17021)] 21:23:09.362565 run osmo-hlr_10.42.42.2(pid=17021): stdout: | (launched: 2022-12-09_21:23:05.294570) 21:23:09.419774 run osmo-hlr_10.42.42.2(pid=17021): stderr: | 20221209212305585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212305585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212305585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212305585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212305585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212305585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212305599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212305616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212305616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212305616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:09.509541 run osmo-msc_10.42.42.6(pid=17029): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17029)] 21:23:09.571415 run osmo-msc_10.42.42.6(pid=17029): stdout: | (launched: 2022-12-09_21:23:07.743234) 21:23:09.627568 run osmo-msc_10.42.42.6(pid=17029): stderr: | 20221209212308308 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212308308 DLGLOBAL DEBUG validating counter group 0x7ff1f447dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212308308 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212308308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212308310 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212308310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212308312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212308312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212308312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212308312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:09.690896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17020): Terminating (SIGTERM) 21:23:09.742564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Terminating (SIGTERM) 21:23:09.790288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Terminating (SIGTERM) 21:23:09.844494 --- ParallelTerminationStrategy: PID 17020 died... 21:23:09.867917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17020): Terminated: ok {rc=0} 21:23:09.923615 --- ParallelTerminationStrategy: PID 17025 died... 21:23:09.948010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17025): Terminated: ok {rc=0} 21:23:10.005356 --- ParallelTerminationStrategy: PID 17028 died... 21:23:10.030298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17028): Terminated: ok {rc=0} 21:23:10.136245 bus /sierra_3: Setting Powered False 21:23:11.250567 bus /sierra_3: Setting Powered False 21:23:12.371086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 21:23:13.660035 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:13.667431 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:23:13.711655 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:23:13.741383 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:23:13.799770 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:23:13.844689 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:23:13.873480 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:23:14.420872 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 21:23:14.427916 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:14.440492 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:23:14.479578 tst handover.py: using LAC 23807 21:23:14.613323 tst handover.py: using RAC 92 21:23:14.746424 tst handover.py: using CellId 23807 21:23:14.878159 tst handover.py: using BVCI 23808 21:23:15.003122 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 21:23:15.038665 tst handover.py: using LAC 23808 21:23:15.175317 tst handover.py: using RAC 93 21:23:15.306922 tst handover.py: using CellId 23808 21:23:15.439272 tst handover.py: using BVCI 23809 21:23:15.564670 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:15.577187 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:15.589600 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:15.601445 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:15.613871 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:23:15.626068 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:23:15.755082 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 21:23:15.897176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:16.431627 run create_hlr_db(pid=17292): Launched 21:23:16.638706 bus /sierra_2: Setting Powered False 21:23:17.737533 run create_hlr_db(pid=17292): Terminated: ok {rc=0} 21:23:18.184280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17294): Launched 21:23:18.535454 run osmo-hlr_10.42.42.2(pid=17295): Launched 21:23:18.790827 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:19.443304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17297): Launched 21:23:19.796590 run osmo-stp_10.42.42.5(pid=17298): Launched 21:23:20.057424 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:20.714624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17300): Launched 21:23:21.068392 run osmo-msc_10.42.42.6(pid=17301): Launched 21:23:21.440384 run osmo-stp_10.42.42.5(pid=17298): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17298)] 21:23:21.735013 run osmo-stp_10.42.42.5(pid=17298): stdout: | (launched: 2022-12-09_21:23:19.734863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:21.902964 run osmo-stp_10.42.42.5(pid=17298): stderr: | 20221209212320034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212320034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212320034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212320035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212320035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212320035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212320036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:22.046353 run osmo-stp_10.42.42.5(pid=17298): stdout: | (launched: 2022-12-09_21:23:19.734863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:22.182814 run osmo-stp_10.42.42.5(pid=17298): stderr: | 20221209212320034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212320034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212320034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212320035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212320035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212320035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212320036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:22.348194 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17298): Process ended prematurely: osmo-stp_10.42.42.5(pid=17298) [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17298)] [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 21:23:22.358557 tst handover.py:18: Test FAILED (7.9 sec) 21:23:22.387739 run osmo-hlr_10.42.42.2(pid=17295): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17295)] 21:23:22.439527 run osmo-hlr_10.42.42.2(pid=17295): stdout: | (launched: 2022-12-09_21:23:18.472484) 21:23:22.493153 run osmo-hlr_10.42.42.2(pid=17295): stderr: | 20221209212318778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212318778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212318778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212318778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212318778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212318778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212318798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212318817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212318818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212318818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:22.570190 run osmo-msc_10.42.42.6(pid=17301): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17301)] 21:23:22.622447 run osmo-msc_10.42.42.6(pid=17301): stdout: | (launched: 2022-12-09_21:23:21.006547) 21:23:22.677638 run osmo-msc_10.42.42.6(pid=17301): stderr: | 20221209212321513 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212321513 DLGLOBAL DEBUG validating counter group 0x7fe0d0373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212321514 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212321514 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212321514 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212321514 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212321516 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212321516 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212321517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212321517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:22.731853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17294): Terminating (SIGTERM) 21:23:22.775682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17297): Terminating (SIGTERM) 21:23:22.820861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17300): Terminating (SIGTERM) 21:23:22.867582 --- ParallelTerminationStrategy: PID 17294 died... 21:23:22.888472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17294): Terminated: ok {rc=0} 21:23:22.939453 --- ParallelTerminationStrategy: PID 17297 died... 21:23:22.960511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17297): Terminated: ok {rc=0} 21:23:23.009151 --- ParallelTerminationStrategy: PID 17300 died... 21:23:23.029676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17300): Terminated: ok {rc=0} 21:23:23.122595 bus /sierra_3: Setting Powered False 21:23:24.228723 bus /sierra_3: Setting Powered False 21:23:25.348770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 21:23:26.597575 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:26.602656 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:23:26.656342 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:23:26.682924 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:23:26.734962 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:23:26.787894 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:23:26.814212 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:23:27.364858 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 21:23:27.370058 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:27.380827 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:23:27.419330 tst handover.py: using LAC 23809 21:23:27.542391 tst handover.py: using RAC 94 21:23:27.664891 tst handover.py: using CellId 23809 21:23:27.785810 tst handover.py: using BVCI 23810 21:23:27.897802 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:23:27.945349 tst handover.py: using LAC 23810 21:23:28.067781 tst handover.py: using RAC 95 21:23:28.190512 tst handover.py: using CellId 23810 21:23:28.314245 tst handover.py: using BVCI 23811 21:23:28.427889 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:28.438828 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:28.449582 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:28.460382 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:28.471457 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:23:28.482297 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:23:28.603654 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:23:28.720800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:29.176335 run create_hlr_db(pid=17307): Launched 21:23:29.293725 bus /sierra_2: Setting Powered False 21:23:30.355436 run create_hlr_db(pid=17307): Terminated: ok {rc=0} 21:23:30.780718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Launched 21:23:31.136485 run osmo-hlr_10.42.42.2(pid=17310): Launched 21:23:31.391183 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:32.063227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Launched 21:23:32.385612 run osmo-stp_10.42.42.5(pid=17313): Launched 21:23:32.565277 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:33.119083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Launched 21:23:33.431799 run osmo-msc_10.42.42.6(pid=17316): Launched 21:23:33.606789 run osmo-stp_10.42.42.5(pid=17313): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] 21:23:33.738715 run osmo-stp_10.42.42.5(pid=17313): stdout: | (launched: 2022-12-09_21:23:32.325006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:33.870240 run osmo-stp_10.42.42.5(pid=17313): stderr: | 20221209212332610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212332610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212332611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212332611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212332611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212332612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212332612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:33.999089 run osmo-stp_10.42.42.5(pid=17313): stdout: | (launched: 2022-12-09_21:23:32.325006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:34.122310 run osmo-stp_10.42.42.5(pid=17313): stderr: | 20221209212332610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212332610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212332611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212332611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212332611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212332612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212332612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:34.270166 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17313): Process ended prematurely: osmo-stp_10.42.42.5(pid=17313) [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 21:23:34.278592 tst handover.py:18: Test FAILED (6.9 sec) 21:23:34.305763 run osmo-hlr_10.42.42.2(pid=17310): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17310)] 21:23:34.353636 run osmo-hlr_10.42.42.2(pid=17310): stdout: | (launched: 2022-12-09_21:23:31.076353) 21:23:34.403318 run osmo-hlr_10.42.42.2(pid=17310): stderr: | 20221209212331315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212331315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212331316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212331316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212331316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212331316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212331334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212331350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212331350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212331350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:34.473199 run osmo-msc_10.42.42.6(pid=17316): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17316)] 21:23:34.521072 run osmo-msc_10.42.42.6(pid=17316): stdout: | (launched: 2022-12-09_21:23:33.373729) 21:23:34.570572 run osmo-msc_10.42.42.6(pid=17316): stderr: | 20221209212333648 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212333648 DLGLOBAL DEBUG validating counter group 0x7f6f82625c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212333648 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212333648 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212333648 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212333649 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212333651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212333651 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212333651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212333651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:34.620413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Terminating (SIGTERM) 21:23:34.660247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Terminating (SIGTERM) 21:23:34.699968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Terminating (SIGTERM) 21:23:34.739731 --- ParallelTerminationStrategy: PID 17309 died... 21:23:34.758666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Terminated: ok {rc=0} 21:23:34.802565 --- ParallelTerminationStrategy: PID 17312 died... 21:23:34.820685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Terminated: ok {rc=0} 21:23:34.864438 --- ParallelTerminationStrategy: PID 17315 died... 21:23:34.882804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Terminated: ok {rc=0} 21:23:34.968696 bus /sierra_3: Setting Powered False 21:23:36.069094 bus /sierra_3: Setting Powered False 21:23:37.186327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 21:23:38.454624 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:38.460456 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:23:38.514536 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:23:38.541915 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:23:38.595932 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:23:38.649785 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:23:38.675950 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:23:39.225912 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 21:23:39.231154 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:39.242213 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:23:39.281804 tst handover.py: using LAC 23811 21:23:39.406490 tst handover.py: using RAC 96 21:23:39.530628 tst handover.py: using CellId 23811 21:23:39.653608 tst handover.py: using BVCI 23812 21:23:39.765763 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:23:39.813300 tst handover.py: using LAC 23812 21:23:39.936609 tst handover.py: using RAC 97 21:23:40.058165 tst handover.py: using CellId 23812 21:23:40.181949 tst handover.py: using BVCI 23813 21:23:40.294545 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:40.305532 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:40.316376 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:40.327631 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:40.338877 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:23:40.350001 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:23:40.473126 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:23:40.592720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:41.079801 run create_hlr_db(pid=17321): Launched 21:23:41.215948 bus /sierra_2: Setting Powered False 21:23:42.280403 run create_hlr_db(pid=17321): Terminated: ok {rc=0} 21:23:42.697025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17323): Launched 21:23:43.006738 run osmo-hlr_10.42.42.2(pid=17324): Launched 21:23:43.125063 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:43.634517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17326): Launched 21:23:43.945506 run osmo-stp_10.42.42.5(pid=17327): Launched 21:23:44.064156 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:44.598067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17329): Launched 21:23:44.908498 run osmo-msc_10.42.42.6(pid=17330): Launched 21:23:45.082038 run osmo-stp_10.42.42.5(pid=17327): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17327)] 21:23:45.213367 run osmo-stp_10.42.42.5(pid=17327): stdout: | (launched: 2022-12-09_21:23:43.887883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:45.344011 run osmo-stp_10.42.42.5(pid=17327): stderr: | 20221209212344059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212344059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212344059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212344060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212344062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212344062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212344062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:45.472504 run osmo-stp_10.42.42.5(pid=17327): stdout: | (launched: 2022-12-09_21:23:43.887883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:45.595866 run osmo-stp_10.42.42.5(pid=17327): stderr: | 20221209212344059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212344059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212344059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212344060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212344062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212344062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212344062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:45.743225 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17327): Process ended prematurely: osmo-stp_10.42.42.5(pid=17327) [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17327)] [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 21:23:45.751743 tst handover.py:18: Test FAILED (6.5 sec) 21:23:45.778462 run osmo-hlr_10.42.42.2(pid=17324): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17324)] 21:23:45.826663 run osmo-hlr_10.42.42.2(pid=17324): stdout: | (launched: 2022-12-09_21:23:42.949058) 21:23:45.878682 run osmo-hlr_10.42.42.2(pid=17324): stderr: | 20221209212343128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212343128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212343128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212343128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212343128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212343128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212343141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212343149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212343149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212343149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:45.956285 run osmo-msc_10.42.42.6(pid=17330): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17330)] 21:23:46.006022 run osmo-msc_10.42.42.6(pid=17330): stdout: | (launched: 2022-12-09_21:23:44.850962) 21:23:46.057500 run osmo-msc_10.42.42.6(pid=17330): stderr: | 20221209212345123 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212345123 DLGLOBAL DEBUG validating counter group 0x7f76acfd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212345123 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212345123 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212345124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212345124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212345126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212345126 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212345126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212345126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:46.109714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17323): Terminating (SIGTERM) 21:23:46.151680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17326): Terminating (SIGTERM) 21:23:46.195121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17329): Terminating (SIGTERM) 21:23:46.238955 --- ParallelTerminationStrategy: PID 17323 died... 21:23:46.258905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17323): Terminated: ok {rc=0} 21:23:46.305975 --- ParallelTerminationStrategy: PID 17326 died... 21:23:46.325778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17326): Terminated: ok {rc=0} 21:23:46.372569 --- ParallelTerminationStrategy: PID 17329 died... 21:23:46.392748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17329): Terminated: ok {rc=0} 21:23:46.480264 bus /sierra_3: Setting Powered False 21:23:47.578640 bus /sierra_3: Setting Powered False 21:23:48.697384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 21:23:49.956804 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:23:49.961902 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 21:23:49.998853 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 21:23:50.025277 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 21:23:50.078715 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 21:23:50.116604 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 21:23:50.143446 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 21:23:50.690411 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 21:23:50.695557 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:50.706409 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:23:50.740509 tst handover.py: using LAC 23813 21:23:50.861278 tst handover.py: using RAC 98 21:23:50.982498 tst handover.py: using CellId 23813 21:23:51.105252 tst handover.py: using BVCI 23814 21:23:51.218442 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 21:23:51.253107 tst handover.py: using LAC 23814 21:23:51.384809 tst handover.py: using RAC 99 21:23:51.519873 tst handover.py: using CellId 23814 21:23:51.651337 tst handover.py: using BVCI 23815 21:23:51.772038 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:51.783406 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:51.794828 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:51.806728 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:51.818335 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 21:23:51.829998 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:23:51.945795 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 21:23:52.065210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:23:52.523947 run create_hlr_db(pid=17335): Launched 21:23:52.645388 bus /sierra_2: Setting Powered False 21:23:53.706530 run create_hlr_db(pid=17335): Terminated: ok {rc=0} 21:23:54.131563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17337): Launched 21:23:54.464003 run osmo-hlr_10.42.42.2(pid=17338): Launched 21:23:54.592040 run osmo-stp_10.42.42.5: Starting osmo-stp 21:23:55.135228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17340): Launched 21:23:55.467579 run osmo-stp_10.42.42.5(pid=17341): Launched 21:23:55.595444 run osmo-msc_10.42.42.6: Starting osmo-msc 21:23:56.165425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17343): Launched 21:23:56.496908 run osmo-msc_10.42.42.6(pid=17344): Launched 21:23:56.683267 run osmo-stp_10.42.42.5(pid=17341): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17341)] 21:23:56.822415 run osmo-stp_10.42.42.5(pid=17341): stdout: | (launched: 2022-12-09_21:23:55.406452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:56.962151 run osmo-stp_10.42.42.5(pid=17341): stderr: | 20221209212355602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212355602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212355602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212355603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212355603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212355603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212355603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:57.100421 run osmo-stp_10.42.42.5(pid=17341): stdout: | (launched: 2022-12-09_21:23:55.406452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:23:57.232184 run osmo-stp_10.42.42.5(pid=17341): stderr: | 20221209212355602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212355602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212355602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212355603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212355603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212355603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212355603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:23:57.389822 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17341): Process ended prematurely: osmo-stp_10.42.42.5(pid=17341) [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17341)] [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 21:23:57.398834 tst handover.py:18: Test FAILED (6.7 sec) 21:23:57.426373 run osmo-hlr_10.42.42.2(pid=17338): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17338)] 21:23:57.476542 run osmo-hlr_10.42.42.2(pid=17338): stdout: | (launched: 2022-12-09_21:23:54.402726) 21:23:57.528334 run osmo-hlr_10.42.42.2(pid=17338): stderr: | 20221209212354605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212354605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212354605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212354605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212354605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212354605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212354619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212354629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212354629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212354629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:23:57.600608 run osmo-msc_10.42.42.6(pid=17344): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17344)] 21:23:57.650584 run osmo-msc_10.42.42.6(pid=17344): stdout: | (launched: 2022-12-09_21:23:56.435163) 21:23:57.702025 run osmo-msc_10.42.42.6(pid=17344): stderr: | 20221209212356763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212356763 DLGLOBAL DEBUG validating counter group 0x7f3ecbe02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212356763 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212356763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212356763 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212356764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212356765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212356766 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212356766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212356766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:23:57.753950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17337): Terminating (SIGTERM) 21:23:57.795421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17340): Terminating (SIGTERM) 21:23:57.836793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17343): Terminating (SIGTERM) 21:23:57.879073 --- ParallelTerminationStrategy: PID 17337 died... 21:23:57.899105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17337): Terminated: ok {rc=0} 21:23:57.945397 --- ParallelTerminationStrategy: PID 17340 died... 21:23:57.964815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17340): Terminated: ok {rc=0} 21:23:58.010961 --- ParallelTerminationStrategy: PID 17343 died... 21:23:58.030490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17343): Terminated: ok {rc=0} 21:23:58.117671 bus /sierra_3: Setting Powered False 21:23:59.218134 bus /sierra_3: Setting Powered False 21:24:00.332369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 21:24:01.598934 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:01.607654 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:24:01.681349 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:24:01.725883 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:24:01.799200 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:24:01.860158 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:24:01.889181 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:24:02.425251 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 21:24:02.431021 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:02.442235 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:24:02.480179 tst handover.py: using LAC 23815 21:24:02.602336 tst handover.py: using RAC 100 21:24:02.723202 tst handover.py: using CellId 23815 21:24:02.844926 tst handover.py: using BVCI 23816 21:24:02.958143 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:24:03.004035 tst handover.py: using LAC 23816 21:24:03.129824 tst handover.py: using RAC 101 21:24:03.251253 tst handover.py: using CellId 23816 21:24:03.370956 tst handover.py: using BVCI 23817 21:24:03.485134 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:03.495833 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:03.506753 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:03.517586 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:03.528529 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:24:03.539391 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:24:03.660224 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:24:03.781562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:04.269325 run create_hlr_db(pid=17349): Launched 21:24:04.404036 bus /sierra_2: Setting Powered False 21:24:05.469294 run create_hlr_db(pid=17349): Terminated: ok {rc=0} 21:24:05.885843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17351): Launched 21:24:06.196278 run osmo-hlr_10.42.42.2(pid=17352): Launched 21:24:06.314866 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:06.821801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17354): Launched 21:24:07.131847 run osmo-stp_10.42.42.5(pid=17355): Launched 21:24:07.251102 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:07.817939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17357): Launched 21:24:08.148886 run osmo-msc_10.42.42.6(pid=17358): Launched 21:24:08.334644 run osmo-stp_10.42.42.5(pid=17355): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17355)] 21:24:08.474132 run osmo-stp_10.42.42.5(pid=17355): stdout: | (launched: 2022-12-09_21:24:07.073971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:08.614893 run osmo-stp_10.42.42.5(pid=17355): stderr: | 20221209212407245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212407245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212407246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212407246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212407247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212407247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212407247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:08.753808 run osmo-stp_10.42.42.5(pid=17355): stdout: | (launched: 2022-12-09_21:24:07.073971) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:08.885582 run osmo-stp_10.42.42.5(pid=17355): stderr: | 20221209212407245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212407245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212407246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212407246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212407247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212407247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212407247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:09.043585 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17355): Process ended prematurely: osmo-stp_10.42.42.5(pid=17355) [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17355)] [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 21:24:09.052563 tst handover.py:18: Test FAILED (6.6 sec) 21:24:09.080359 run osmo-hlr_10.42.42.2(pid=17352): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17352)] 21:24:09.131406 run osmo-hlr_10.42.42.2(pid=17352): stdout: | (launched: 2022-12-09_21:24:06.138514) 21:24:09.183550 run osmo-hlr_10.42.42.2(pid=17352): stderr: | 20221209212406316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212406316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212406316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212406316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212406316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212406316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212406343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212406352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212406352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212406352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:09.255996 run osmo-msc_10.42.42.6(pid=17358): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17358)] 21:24:09.306103 run osmo-msc_10.42.42.6(pid=17358): stdout: | (launched: 2022-12-09_21:24:08.087741) 21:24:09.357761 run osmo-msc_10.42.42.6(pid=17358): stderr: | 20221209212408412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212408412 DLGLOBAL DEBUG validating counter group 0x7f8d34038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212408412 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212408412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212408412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212408413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212408414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212408415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212408415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212408415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:09.409822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17351): Terminating (SIGTERM) 21:24:09.451301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17354): Terminating (SIGTERM) 21:24:09.492766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17357): Terminating (SIGTERM) 21:24:09.534993 --- ParallelTerminationStrategy: PID 17351 died... 21:24:09.555081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17351): Terminated: ok {rc=0} 21:24:09.601453 --- ParallelTerminationStrategy: PID 17354 died... 21:24:09.620732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17354): Terminated: ok {rc=0} 21:24:09.666804 --- ParallelTerminationStrategy: PID 17357 died... 21:24:09.686254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17357): Terminated: ok {rc=0} 21:24:09.774295 bus /sierra_3: Setting Powered False 21:24:10.874870 bus /sierra_3: Setting Powered False 21:24:11.990289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:24:13.251388 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:13.256837 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:24:13.304238 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:24:13.331585 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:24:13.385790 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:24:13.433511 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:24:13.460618 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:24:14.013672 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:24:14.018941 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:14.030428 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:24:14.067560 tst handover.py: using LAC 23817 21:24:14.199996 tst handover.py: using RAC 102 21:24:14.333118 tst handover.py: using CellId 23817 21:24:14.463313 tst handover.py: using BVCI 23818 21:24:14.585987 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:24:14.633781 tst handover.py: using LAC 23818 21:24:14.765304 tst handover.py: using RAC 103 21:24:14.896647 tst handover.py: using CellId 23818 21:24:15.026749 tst handover.py: using BVCI 23819 21:24:15.147445 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:15.159095 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:15.170456 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:15.182298 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:15.194289 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:24:15.206050 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:24:15.324074 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:24:15.441528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:15.934239 run create_hlr_db(pid=17363): Launched 21:24:16.103710 bus /sierra_2: Setting Powered False 21:24:17.180036 run create_hlr_db(pid=17363): Terminated: ok {rc=0} 21:24:17.604020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17365): Launched 21:24:17.913704 run osmo-hlr_10.42.42.2(pid=17366): Launched 21:24:18.030479 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:18.534355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17368): Launched 21:24:18.846249 run osmo-stp_10.42.42.5(pid=17369): Launched 21:24:18.964242 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:19.498095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17371): Launched 21:24:19.808462 run osmo-msc_10.42.42.6(pid=17372): Launched 21:24:19.981527 run osmo-stp_10.42.42.5(pid=17369): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17369)] 21:24:20.112361 run osmo-stp_10.42.42.5(pid=17369): stdout: | (launched: 2022-12-09_21:24:18.788473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:20.243340 run osmo-stp_10.42.42.5(pid=17369): stderr: | 20221209212418963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212418963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212418963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212418963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212418964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212418964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212418964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:20.371732 run osmo-stp_10.42.42.5(pid=17369): stdout: | (launched: 2022-12-09_21:24:18.788473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:20.494891 run osmo-stp_10.42.42.5(pid=17369): stderr: | 20221209212418963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212418963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212418963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212418963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212418964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212418964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212418964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:20.642264 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17369): Process ended prematurely: osmo-stp_10.42.42.5(pid=17369) [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17369)] [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 21:24:20.650989 tst handover.py:18: Test FAILED (6.6 sec) 21:24:20.677601 run osmo-hlr_10.42.42.2(pid=17366): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17366)] 21:24:20.725402 run osmo-hlr_10.42.42.2(pid=17366): stdout: | (launched: 2022-12-09_21:24:17.856084) 21:24:20.774341 run osmo-hlr_10.42.42.2(pid=17366): stderr: | 20221209212418038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212418038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212418038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212418038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212418038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212418038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212418115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212418125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212418126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212418126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:20.842736 run osmo-msc_10.42.42.6(pid=17372): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17372)] 21:24:20.889749 run osmo-msc_10.42.42.6(pid=17372): stdout: | (launched: 2022-12-09_21:24:19.750816) 21:24:20.938572 run osmo-msc_10.42.42.6(pid=17372): stderr: | 20221209212420024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212420025 DLGLOBAL DEBUG validating counter group 0x7fcbb5be6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212420025 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212420025 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212420025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212420025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212420027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212420027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212420027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212420028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:20.987867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17365): Terminating (SIGTERM) 21:24:21.027084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17368): Terminating (SIGTERM) 21:24:21.066385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17371): Terminating (SIGTERM) 21:24:21.105904 --- ParallelTerminationStrategy: PID 17365 died... 21:24:21.124779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17365): Terminated: ok {rc=0} 21:24:21.168730 --- ParallelTerminationStrategy: PID 17368 died... 21:24:21.187166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17368): Terminated: ok {rc=0} 21:24:21.231021 --- ParallelTerminationStrategy: PID 17371 died... 21:24:21.249449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17371): Terminated: ok {rc=0} 21:24:21.333087 bus /sierra_3: Setting Powered False 21:24:22.430968 bus /sierra_3: Setting Powered False 21:24:23.549541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:24:24.803585 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:24.808600 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:24:24.859451 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:24:24.886045 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:24:24.938781 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:24:24.990225 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:24:25.016457 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:24:25.565472 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:24:25.570599 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:25.581660 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:24:25.615636 tst handover.py: using LAC 23819 21:24:25.738211 tst handover.py: using RAC 104 21:24:25.869427 tst handover.py: using CellId 23819 21:24:26.001226 tst handover.py: using BVCI 23820 21:24:26.122091 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:24:26.173048 tst handover.py: using LAC 23820 21:24:26.303772 tst handover.py: using RAC 105 21:24:26.433910 tst handover.py: using CellId 23820 21:24:26.564526 tst handover.py: using BVCI 23821 21:24:26.687437 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:26.699301 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:26.710954 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:26.722852 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:26.734440 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:24:26.746008 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:24:26.863808 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:24:26.982857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:27.436320 run create_hlr_db(pid=17377): Launched 21:24:27.554411 bus /sierra_2: Setting Powered False 21:24:28.615972 run create_hlr_db(pid=17377): Terminated: ok {rc=0} 21:24:29.022097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17379): Launched 21:24:29.332386 run osmo-hlr_10.42.42.2(pid=17380): Launched 21:24:29.450761 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:29.961636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17382): Launched 21:24:30.270607 run osmo-stp_10.42.42.5(pid=17383): Launched 21:24:30.388809 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:30.957681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17385): Launched 21:24:31.285832 run osmo-msc_10.42.42.6(pid=17386): Launched 21:24:31.513372 run osmo-stp_10.42.42.5(pid=17383): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17383)] 21:24:31.658054 run osmo-stp_10.42.42.5(pid=17383): stdout: | (launched: 2022-12-09_21:24:30.213148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:31.858658 run osmo-stp_10.42.42.5(pid=17383): stderr: | 20221209212430387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212430387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212430387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212430387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212430388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212430388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212430388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:32.115867 run osmo-stp_10.42.42.5(pid=17383): stdout: | (launched: 2022-12-09_21:24:30.213148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:32.266070 run osmo-stp_10.42.42.5(pid=17383): stderr: | 20221209212430387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212430387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212430387 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212430387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212430388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212430388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212430388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:32.419266 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17383): Process ended prematurely: osmo-stp_10.42.42.5(pid=17383) [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17383)] [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 21:24:32.427964 tst handover.py:18: Test FAILED (6.9 sec) 21:24:32.454678 run osmo-hlr_10.42.42.2(pid=17380): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17380)] 21:24:32.502975 run osmo-hlr_10.42.42.2(pid=17380): stdout: | (launched: 2022-12-09_21:24:29.274540) 21:24:32.552348 run osmo-hlr_10.42.42.2(pid=17380): stderr: | 20221209212429453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212429453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212429453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212429453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212429453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212429453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212429465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212429474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212429474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212429474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:32.621854 run osmo-msc_10.42.42.6(pid=17386): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17386)] 21:24:32.669887 run osmo-msc_10.42.42.6(pid=17386): stdout: | (launched: 2022-12-09_21:24:31.226978) 21:24:32.719140 run osmo-msc_10.42.42.6(pid=17386): stderr: | 20221209212431872 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212431872 DLGLOBAL DEBUG validating counter group 0x7f3e2067cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212431875 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212431875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212431875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212431875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212431880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212431880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212431881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212431881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:32.769108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17379): Terminating (SIGTERM) 21:24:32.808587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17382): Terminating (SIGTERM) 21:24:32.848092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17385): Terminating (SIGTERM) 21:24:32.887836 --- ParallelTerminationStrategy: PID 17379 died... 21:24:32.906786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17379): Terminated: ok {rc=0} 21:24:32.951351 --- ParallelTerminationStrategy: PID 17382 died... 21:24:32.969753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17382): Terminated: ok {rc=0} 21:24:33.013595 --- ParallelTerminationStrategy: PID 17385 died... 21:24:33.032000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17385): Terminated: ok {rc=0} 21:24:33.117402 bus /sierra_3: Setting Powered False 21:24:34.219799 bus /sierra_3: Setting Powered False 21:24:35.336733 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 21:24:36.592295 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:36.597746 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:24:36.635966 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:24:36.662620 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:24:36.715821 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:24:36.753454 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:24:36.779912 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:24:37.329668 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 21:24:37.334816 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:37.345777 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:24:37.384111 tst handover.py: using LAC 23821 21:24:37.505385 tst handover.py: using RAC 106 21:24:37.624783 tst handover.py: using CellId 23821 21:24:37.744070 tst handover.py: using BVCI 23822 21:24:37.855666 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 21:24:37.893133 tst handover.py: using LAC 23822 21:24:38.013886 tst handover.py: using RAC 107 21:24:38.135751 tst handover.py: using CellId 23822 21:24:38.265868 tst handover.py: using BVCI 23823 21:24:38.386260 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:38.397774 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:38.408920 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:38.420728 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:38.432617 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:24:38.444344 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:24:38.567832 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 21:24:38.686428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:39.141091 run create_hlr_db(pid=17391): Launched 21:24:39.259120 bus /sierra_2: Setting Powered False 21:24:40.320279 run create_hlr_db(pid=17391): Terminated: ok {rc=0} 21:24:40.743767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17393): Launched 21:24:41.076378 run osmo-hlr_10.42.42.2(pid=17394): Launched 21:24:41.203987 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:41.746464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17396): Launched 21:24:42.078076 run osmo-stp_10.42.42.5(pid=17397): Launched 21:24:42.206005 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:42.776868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17399): Launched 21:24:43.108858 run osmo-msc_10.42.42.6(pid=17400): Launched 21:24:43.294188 run osmo-stp_10.42.42.5(pid=17397): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17397)] 21:24:43.432599 run osmo-stp_10.42.42.5(pid=17397): stdout: | (launched: 2022-12-09_21:24:42.016729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:43.571498 run osmo-stp_10.42.42.5(pid=17397): stderr: | 20221209212442211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212442212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212442212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212442212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212442213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212442213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212442213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:43.710639 run osmo-stp_10.42.42.5(pid=17397): stdout: | (launched: 2022-12-09_21:24:42.016729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:43.841972 run osmo-stp_10.42.42.5(pid=17397): stderr: | 20221209212442211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212442212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212442212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212442212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212442213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212442213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212442213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:43.999054 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17397): Process ended prematurely: osmo-stp_10.42.42.5(pid=17397) [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17397)] [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 21:24:44.008097 tst handover.py:18: Test FAILED (6.7 sec) 21:24:44.035799 run osmo-hlr_10.42.42.2(pid=17394): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17394)] 21:24:44.085931 run osmo-hlr_10.42.42.2(pid=17394): stdout: | (launched: 2022-12-09_21:24:41.015277) 21:24:44.137649 run osmo-hlr_10.42.42.2(pid=17394): stderr: | 20221209212441215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212441215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212441215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212441215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212441215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212441215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212441227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212441236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212441236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212441236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:44.209662 run osmo-msc_10.42.42.6(pid=17400): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17400)] 21:24:44.259728 run osmo-msc_10.42.42.6(pid=17400): stdout: | (launched: 2022-12-09_21:24:43.047367) 21:24:44.311281 run osmo-msc_10.42.42.6(pid=17400): stderr: | 20221209212443376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212443376 DLGLOBAL DEBUG validating counter group 0x7fb31e728c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212443376 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212443376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212443377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212443377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212443378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212443379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212443379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212443379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:44.363420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17393): Terminating (SIGTERM) 21:24:44.405160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17396): Terminating (SIGTERM) 21:24:44.446727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17399): Terminating (SIGTERM) 21:24:44.488543 --- ParallelTerminationStrategy: PID 17393 died... 21:24:44.508535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17393): Terminated: ok {rc=0} 21:24:44.555081 --- ParallelTerminationStrategy: PID 17396 died... 21:24:44.574714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17396): Terminated: ok {rc=0} 21:24:44.621356 --- ParallelTerminationStrategy: PID 17399 died... 21:24:44.640984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17399): Terminated: ok {rc=0} 21:24:44.729993 bus /sierra_3: Setting Powered False 21:24:45.828119 bus /sierra_3: Setting Powered False 21:24:46.956904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 21:24:48.193898 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:48.199020 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:24:48.249098 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:24:48.275526 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:24:48.328004 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:24:48.379960 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:24:48.407573 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:24:48.960700 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 21:24:48.967081 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:48.979792 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:24:49.018772 tst handover.py: using LAC 23823 21:24:49.141198 tst handover.py: using RAC 108 21:24:49.271481 tst handover.py: using CellId 23823 21:24:49.399836 tst handover.py: using BVCI 23824 21:24:49.521635 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:24:49.570558 tst handover.py: using LAC 23824 21:24:49.701268 tst handover.py: using RAC 109 21:24:49.829927 tst handover.py: using CellId 23824 21:24:49.957826 tst handover.py: using BVCI 23825 21:24:50.078156 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:50.089808 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:50.101332 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:50.112501 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:50.123688 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:24:50.134813 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:24:50.252676 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:24:50.374303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:24:50.859888 run create_hlr_db(pid=17405): Launched 21:24:50.994520 bus /sierra_2: Setting Powered False 21:24:52.059526 run create_hlr_db(pid=17405): Terminated: ok {rc=0} 21:24:52.491963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17407): Launched 21:24:52.824788 run osmo-hlr_10.42.42.2(pid=17408): Launched 21:24:52.952736 run osmo-stp_10.42.42.5: Starting osmo-stp 21:24:53.493508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17410): Launched 21:24:53.825486 run osmo-stp_10.42.42.5(pid=17411): Launched 21:24:53.953846 run osmo-msc_10.42.42.6: Starting osmo-msc 21:24:54.524232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17413): Launched 21:24:54.856411 run osmo-msc_10.42.42.6(pid=17414): Launched 21:24:55.042683 run osmo-stp_10.42.42.5(pid=17411): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17411)] 21:24:55.181525 run osmo-stp_10.42.42.5(pid=17411): stdout: | (launched: 2022-12-09_21:24:53.764210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:55.321178 run osmo-stp_10.42.42.5(pid=17411): stderr: | 20221209212453958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212453958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212453958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212453959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212453961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212453961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212453961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:55.459828 run osmo-stp_10.42.42.5(pid=17411): stdout: | (launched: 2022-12-09_21:24:53.764210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:24:55.591380 run osmo-stp_10.42.42.5(pid=17411): stderr: | 20221209212453958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212453958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212453958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212453959 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212453961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212453961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212453961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:24:55.749261 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17411): Process ended prematurely: osmo-stp_10.42.42.5(pid=17411) [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17411)] [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 21:24:55.758629 tst handover.py:18: Test FAILED (6.8 sec) 21:24:55.786263 run osmo-hlr_10.42.42.2(pid=17408): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17408)] 21:24:55.836416 run osmo-hlr_10.42.42.2(pid=17408): stdout: | (launched: 2022-12-09_21:24:52.763680) 21:24:55.888086 run osmo-hlr_10.42.42.2(pid=17408): stderr: | 20221209212452966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212452966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212452966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212452966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212452966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212452966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212452980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212452990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212452990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212452990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:24:55.959883 run osmo-msc_10.42.42.6(pid=17414): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17414)] 21:24:56.009603 run osmo-msc_10.42.42.6(pid=17414): stdout: | (launched: 2022-12-09_21:24:54.795013) 21:24:56.060929 run osmo-msc_10.42.42.6(pid=17414): stderr: | 20221209212455121 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212455121 DLGLOBAL DEBUG validating counter group 0x7f4c73859c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212455121 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212455121 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212455121 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212455121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212455123 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212455124 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212455124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212455124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:24:56.112628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17407): Terminating (SIGTERM) 21:24:56.153917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17410): Terminating (SIGTERM) 21:24:56.195302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17413): Terminating (SIGTERM) 21:24:56.237097 --- ParallelTerminationStrategy: PID 17407 died... 21:24:56.256750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17407): Terminated: ok {rc=0} 21:24:56.303076 --- ParallelTerminationStrategy: PID 17410 died... 21:24:56.322569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17410): Terminated: ok {rc=0} 21:24:56.368371 --- ParallelTerminationStrategy: PID 17413 died... 21:24:56.387922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17413): Terminated: ok {rc=0} 21:24:56.474635 bus /sierra_3: Setting Powered False 21:24:57.574633 bus /sierra_3: Setting Powered False 21:24:58.690256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 21:24:59.946084 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:24:59.952277 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:25:00.002880 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:25:00.029081 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:25:00.080384 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:25:00.131785 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:25:00.159471 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:25:00.708655 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 21:25:00.714814 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:00.726150 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:25:00.761764 tst handover.py: using LAC 23825 21:25:00.893986 tst handover.py: using RAC 110 21:25:01.026865 tst handover.py: using CellId 23825 21:25:01.161263 tst handover.py: using BVCI 23826 21:25:01.286960 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:25:01.334902 tst handover.py: using LAC 23826 21:25:01.465533 tst handover.py: using RAC 111 21:25:01.615952 tst handover.py: using CellId 23826 21:25:01.782224 tst handover.py: using BVCI 23827 21:25:01.942144 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:01.958344 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:01.974638 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:01.992195 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:02.010045 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:25:02.026749 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:25:02.181172 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:25:02.325676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:02.861682 run create_hlr_db(pid=17445): Launched 21:25:03.031097 bus /sierra_2: Setting Powered False 21:25:04.095875 run create_hlr_db(pid=17445): Terminated: ok {rc=0} 21:25:04.527700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Launched 21:25:04.859311 run osmo-hlr_10.42.42.2(pid=17503): Launched 21:25:04.986663 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:05.510489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Launched 21:25:05.820937 run osmo-stp_10.42.42.5(pid=17506): Launched 21:25:05.937803 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:06.470053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17508): Launched 21:25:06.781697 run osmo-msc_10.42.42.6(pid=17509): Launched 21:25:06.957056 run osmo-stp_10.42.42.5(pid=17506): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] 21:25:07.088301 run osmo-stp_10.42.42.5(pid=17506): stdout: | (launched: 2022-12-09_21:25:05.763284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:07.218914 run osmo-stp_10.42.42.5(pid=17506): stderr: | 20221209212505936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212505936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212505937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212505937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212505939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212505939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212505939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:07.347801 run osmo-stp_10.42.42.5(pid=17506): stdout: | (launched: 2022-12-09_21:25:05.763284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:07.470366 run osmo-stp_10.42.42.5(pid=17506): stderr: | 20221209212505936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212505936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212505937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212505937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212505939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212505939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212505939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:07.617429 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17506): Process ended prematurely: osmo-stp_10.42.42.5(pid=17506) [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 21:25:07.625939 tst handover.py:18: Test FAILED (6.9 sec) 21:25:07.652512 run osmo-hlr_10.42.42.2(pid=17503): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17503)] 21:25:07.700304 run osmo-hlr_10.42.42.2(pid=17503): stdout: | (launched: 2022-12-09_21:25:04.798254) 21:25:07.749660 run osmo-hlr_10.42.42.2(pid=17503): stderr: | 20221209212504998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212504998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212504998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212504998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212504998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212504998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212505013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212505021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212505021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212505021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:07.818675 run osmo-msc_10.42.42.6(pid=17509): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17509)] 21:25:07.866443 run osmo-msc_10.42.42.6(pid=17509): stdout: | (launched: 2022-12-09_21:25:06.724008) 21:25:07.915381 run osmo-msc_10.42.42.6(pid=17509): stderr: | 20221209212506998 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212506998 DLGLOBAL DEBUG validating counter group 0x7ff1bb9ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212506998 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212506998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212506998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212506998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212507000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212507001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212507001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212507001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:07.965434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Terminating (SIGTERM) 21:25:08.004895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Terminating (SIGTERM) 21:25:08.044370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17508): Terminating (SIGTERM) 21:25:08.084333 --- ParallelTerminationStrategy: PID 17502 died... 21:25:08.103373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Terminated: ok {rc=0} 21:25:08.147736 --- ParallelTerminationStrategy: PID 17505 died... 21:25:08.166208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Terminated: ok {rc=0} 21:25:08.210250 --- ParallelTerminationStrategy: PID 17508 died... 21:25:08.228709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17508): Terminated: ok {rc=0} 21:25:08.315276 bus /sierra_3: Setting Powered False 21:25:09.416319 bus /sierra_3: Setting Powered False 21:25:10.532123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 21:25:11.781190 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:11.786215 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 21:25:11.835138 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 21:25:11.861685 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 21:25:11.912009 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 21:25:11.960521 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 21:25:11.986795 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 21:25:12.538966 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 21:25:12.544062 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:12.554967 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:25:12.589180 tst handover.py: using LAC 23827 21:25:12.709070 tst handover.py: using RAC 112 21:25:12.829549 tst handover.py: using CellId 23827 21:25:12.959758 tst handover.py: using BVCI 23828 21:25:13.080083 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 21:25:13.128681 tst handover.py: using LAC 23828 21:25:13.256785 tst handover.py: using RAC 113 21:25:13.384928 tst handover.py: using CellId 23828 21:25:13.516098 tst handover.py: using BVCI 23829 21:25:13.638875 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:13.650727 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:13.662019 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:13.673388 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:13.685122 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 21:25:13.696258 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:25:13.814149 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 21:25:13.936458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:14.430925 run create_hlr_db(pid=17538): Launched 21:25:14.599334 bus /sierra_2: Setting Powered False 21:25:15.701999 run create_hlr_db(pid=17538): Terminated: ok {rc=0} 21:25:16.186415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Launched 21:25:16.533377 run osmo-hlr_10.42.42.2(pid=17541): Launched 21:25:16.811540 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:17.501348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Launched 21:25:17.908739 run osmo-stp_10.42.42.5(pid=17544): Launched 21:25:18.198063 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:18.796688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17546): Launched 21:25:19.125104 run osmo-msc_10.42.42.6(pid=17547): Launched 21:25:19.480541 run osmo-stp_10.42.42.5(pid=17544): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] 21:25:19.750985 run osmo-stp_10.42.42.5(pid=17544): stdout: | (launched: 2022-12-09_21:25:17.847089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:20.043018 run osmo-stp_10.42.42.5(pid=17544): stderr: | 20221209212518040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212518040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212518040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212518044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212518044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212518044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212518044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:20.204537 run osmo-stp_10.42.42.5(pid=17544): stdout: | (launched: 2022-12-09_21:25:17.847089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:20.330891 run osmo-stp_10.42.42.5(pid=17544): stderr: | 20221209212518040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212518040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212518040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212518044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212518044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212518044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212518044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:20.483234 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17544): Process ended prematurely: osmo-stp_10.42.42.5(pid=17544) [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 21:25:20.492711 tst handover.py:18: Test FAILED (7.9 sec) 21:25:20.522418 run osmo-hlr_10.42.42.2(pid=17541): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17541)] 21:25:20.573889 run osmo-hlr_10.42.42.2(pid=17541): stdout: | (launched: 2022-12-09_21:25:16.472191) 21:25:20.626132 run osmo-hlr_10.42.42.2(pid=17541): stderr: | 20221209212516732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212516732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212516732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212516732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212516732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212516732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212516747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212516759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212516759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212516760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:20.698540 run osmo-msc_10.42.42.6(pid=17547): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17547)] 21:25:20.750766 run osmo-msc_10.42.42.6(pid=17547): stdout: | (launched: 2022-12-09_21:25:19.066670) 21:25:20.802846 run osmo-msc_10.42.42.6(pid=17547): stderr: | 20221209212519635 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212519635 DLGLOBAL DEBUG validating counter group 0x7ff3dd201c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212519635 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212519635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212519635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212519636 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212519649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212519650 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212519650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212519650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:20.855122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Terminating (SIGTERM) 21:25:20.898407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Terminating (SIGTERM) 21:25:20.942753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17546): Terminating (SIGTERM) 21:25:20.988605 --- ParallelTerminationStrategy: PID 17540 died... 21:25:21.008716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17540): Terminated: ok {rc=0} 21:25:21.113778 --- ParallelTerminationStrategy: PID 17543 died... 21:25:21.189157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17543): Terminated: ok {rc=0} 21:25:21.324671 --- ParallelTerminationStrategy: PID 17546 died... 21:25:21.345147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17546): Terminated: ok {rc=0} 21:25:21.462473 bus /sierra_3: Setting Powered False 21:25:22.593822 bus /sierra_3: Setting Powered False 21:25:23.751233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:25:25.031290 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:25.037377 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:25:25.087706 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:25:25.117304 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:25:25.171020 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:25:25.219522 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:25:25.248611 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:25:25.840665 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:25:25.846430 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:25.862510 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:25:25.907205 tst handover.py: using LAC 23829 21:25:26.059804 tst handover.py: using RAC 114 21:25:26.194817 tst handover.py: using CellId 23829 21:25:26.367585 tst handover.py: using BVCI 23830 21:25:26.507174 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:25:26.557185 tst handover.py: using LAC 23830 21:25:26.713554 tst handover.py: using RAC 115 21:25:26.848855 tst handover.py: using CellId 23830 21:25:26.984701 tst handover.py: using BVCI 23831 21:25:27.112893 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:27.124615 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:27.136228 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:27.148831 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:27.162815 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:25:27.175447 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:25:27.301462 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:25:27.428807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:27.897765 run create_hlr_db(pid=17554): Launched 21:25:28.061558 bus /sierra_2: Setting Powered False 21:25:29.127847 run create_hlr_db(pid=17554): Terminated: ok {rc=0} 21:25:29.554414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17556): Launched 21:25:29.884634 run osmo-hlr_10.42.42.2(pid=17557): Launched 21:25:30.032505 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:30.727553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17559): Launched 21:25:31.089803 run osmo-stp_10.42.42.5(pid=17560): Launched 21:25:31.249216 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:32.138437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17562): Launched 21:25:32.556886 run osmo-msc_10.42.42.6(pid=17563): Launched 21:25:33.016514 run osmo-stp_10.42.42.5(pid=17560): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17560)] 21:25:33.327523 run osmo-stp_10.42.42.5(pid=17560): stdout: | (launched: 2022-12-09_21:25:31.028703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:33.536308 run osmo-stp_10.42.42.5(pid=17560): stderr: | 20221209212531376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212531377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212531377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212531377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212531378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212531378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212531378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:33.683199 run osmo-stp_10.42.42.5(pid=17560): stdout: | (launched: 2022-12-09_21:25:31.028703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:33.817418 run osmo-stp_10.42.42.5(pid=17560): stderr: | 20221209212531376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212531377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212531377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212531377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212531378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212531378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212531378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:33.978789 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17560): Process ended prematurely: osmo-stp_10.42.42.5(pid=17560) [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17560)] [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 21:25:33.988134 tst handover.py:18: Test FAILED (8.1 sec) 21:25:34.016370 run osmo-hlr_10.42.42.2(pid=17557): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17557)] 21:25:34.067299 run osmo-hlr_10.42.42.2(pid=17557): stdout: | (launched: 2022-12-09_21:25:29.825061) 21:25:34.119872 run osmo-hlr_10.42.42.2(pid=17557): stderr: | 20221209212530167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212530167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212530167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212530167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212530167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212530167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212530190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212530211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212530211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212530211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:34.193903 run osmo-msc_10.42.42.6(pid=17563): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17563)] 21:25:34.244579 run osmo-msc_10.42.42.6(pid=17563): stdout: | (launched: 2022-12-09_21:25:32.486845) 21:25:34.298215 run osmo-msc_10.42.42.6(pid=17563): stderr: | 20221209212533064 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212533065 DLGLOBAL DEBUG validating counter group 0x7fb5fc7c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212533065 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212533065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212533065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212533065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212533074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212533074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212533078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212533078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:34.352474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17556): Terminating (SIGTERM) 21:25:34.396045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17559): Terminating (SIGTERM) 21:25:34.441793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17562): Terminating (SIGTERM) 21:25:34.487418 --- ParallelTerminationStrategy: PID 17556 died... 21:25:34.508278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17556): Terminated: ok {rc=0} 21:25:34.558050 --- ParallelTerminationStrategy: PID 17559 died... 21:25:34.578382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17559): Terminated: ok {rc=0} 21:25:34.626251 --- ParallelTerminationStrategy: PID 17562 died... 21:25:34.647174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17562): Terminated: ok {rc=0} 21:25:34.738269 bus /sierra_3: Setting Powered False 21:25:35.848657 bus /sierra_3: Setting Powered False 21:25:36.998936 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:25:38.297996 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:38.304896 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:25:38.357507 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:25:38.385957 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:25:38.441720 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:25:38.523944 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:25:38.552677 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:25:39.109983 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:25:39.116462 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:39.132746 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:25:39.166881 tst handover.py: using LAC 23831 21:25:39.317650 tst handover.py: using RAC 116 21:25:39.476592 tst handover.py: using CellId 23831 21:25:39.609288 tst handover.py: using BVCI 23832 21:25:39.726521 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:25:39.784573 tst handover.py: using LAC 23832 21:25:39.917404 tst handover.py: using RAC 117 21:25:40.039931 tst handover.py: using CellId 23832 21:25:40.186259 tst handover.py: using BVCI 23833 21:25:40.314770 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:40.326951 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:40.339034 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:40.351157 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:40.363287 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:25:40.375290 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:25:40.518040 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:25:40.667111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:41.158331 run create_hlr_db(pid=17568): Launched 21:25:41.362462 bus /sierra_2: Setting Powered False 21:25:42.452737 run create_hlr_db(pid=17568): Terminated: ok {rc=0} 21:25:42.880636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17570): Launched 21:25:43.209647 run osmo-hlr_10.42.42.2(pid=17571): Launched 21:25:43.449223 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:44.136888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17573): Launched 21:25:44.465906 run osmo-stp_10.42.42.5(pid=17574): Launched 21:25:44.713235 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:45.391322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17576): Launched 21:25:45.757139 run osmo-msc_10.42.42.6(pid=17577): Launched 21:25:46.139209 run osmo-stp_10.42.42.5(pid=17574): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17574)] 21:25:46.399509 run osmo-stp_10.42.42.5(pid=17574): stdout: | (launched: 2022-12-09_21:25:44.407718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:46.571814 run osmo-stp_10.42.42.5(pid=17574): stderr: | 20221209212544730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212544730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212544731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212544731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212544731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212544732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212544732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:46.763298 run osmo-stp_10.42.42.5(pid=17574): stdout: | (launched: 2022-12-09_21:25:44.407718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:46.897398 run osmo-stp_10.42.42.5(pid=17574): stderr: | 20221209212544730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212544730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212544731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212544731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212544731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212544732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212544732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:47.052486 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17574): Process ended prematurely: osmo-stp_10.42.42.5(pid=17574) [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17574)] [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 21:25:47.062002 tst handover.py:18: Test FAILED (7.9 sec) 21:25:47.092001 run osmo-hlr_10.42.42.2(pid=17571): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17571)] 21:25:47.143611 run osmo-hlr_10.42.42.2(pid=17571): stdout: | (launched: 2022-12-09_21:25:43.150962) 21:25:47.196246 run osmo-hlr_10.42.42.2(pid=17571): stderr: | 20221209212543482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212543482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212543482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212543482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212543483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212543483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212543504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212543519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212543519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212543519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:25:47.269876 run osmo-msc_10.42.42.6(pid=17577): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17577)] 21:25:47.321832 run osmo-msc_10.42.42.6(pid=17577): stdout: | (launched: 2022-12-09_21:25:45.695863) 21:25:47.374929 run osmo-msc_10.42.42.6(pid=17577): stderr: | 20221209212546316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212546316 DLGLOBAL DEBUG validating counter group 0x7ff76da4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212546317 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212546317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212546317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212546317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212546319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212546319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212546319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212546319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:25:47.427984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17570): Terminating (SIGTERM) 21:25:47.471372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17573): Terminating (SIGTERM) 21:25:47.517011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17576): Terminating (SIGTERM) 21:25:47.562141 --- ParallelTerminationStrategy: PID 17570 died... 21:25:47.582489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17570): Terminated: ok {rc=0} 21:25:47.632040 --- ParallelTerminationStrategy: PID 17573 died... 21:25:47.651737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17573): Terminated: ok {rc=0} 21:25:47.699877 --- ParallelTerminationStrategy: PID 17576 died... 21:25:47.720396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17576): Terminated: ok {rc=0} 21:25:47.816444 bus /sierra_3: Setting Powered False 21:25:48.925724 bus /sierra_3: Setting Powered False 21:25:50.066860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 21:25:51.377044 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:25:51.383135 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:25:51.422736 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:25:51.450769 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:25:51.505768 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:25:51.565421 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:25:51.600247 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:25:52.125438 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 21:25:52.131423 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:52.148086 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:25:52.190097 tst handover.py: using LAC 23833 21:25:52.315747 tst handover.py: using RAC 118 21:25:52.439601 tst handover.py: using CellId 23833 21:25:52.566414 tst handover.py: using BVCI 23834 21:25:52.684890 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 21:25:52.719171 tst handover.py: using LAC 23834 21:25:52.847411 tst handover.py: using RAC 119 21:25:52.978886 tst handover.py: using CellId 23834 21:25:53.112546 tst handover.py: using BVCI 23835 21:25:53.241266 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:53.252891 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:53.264495 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:53.278348 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:53.291046 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:25:53.302633 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:25:53.424841 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 21:25:53.551067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:25:54.017757 run create_hlr_db(pid=17582): Launched 21:25:54.172551 bus /sierra_2: Setting Powered False 21:25:55.238113 run create_hlr_db(pid=17582): Terminated: ok {rc=0} 21:25:55.653950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17584): Launched 21:25:56.014224 run osmo-hlr_10.42.42.2(pid=17585): Launched 21:25:56.288230 run osmo-stp_10.42.42.5: Starting osmo-stp 21:25:56.949669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17587): Launched 21:25:57.334852 run osmo-stp_10.42.42.5(pid=17588): Launched 21:25:57.585093 run osmo-msc_10.42.42.6: Starting osmo-msc 21:25:58.253583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17590): Launched 21:25:58.614242 run osmo-msc_10.42.42.6(pid=17591): Launched 21:25:58.991590 run osmo-stp_10.42.42.5(pid=17588): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17588)] 21:25:59.308514 run osmo-stp_10.42.42.5(pid=17588): stdout: | (launched: 2022-12-09_21:25:57.272837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:59.542926 run osmo-stp_10.42.42.5(pid=17588): stderr: | 20221209212557567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212557567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212557567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212557568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212557568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212557568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212557568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:59.684785 run osmo-stp_10.42.42.5(pid=17588): stdout: | (launched: 2022-12-09_21:25:57.272837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:25:59.820059 run osmo-stp_10.42.42.5(pid=17588): stderr: | 20221209212557567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212557567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212557567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212557568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212557568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212557568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212557568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:25:59.980855 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17588): Process ended prematurely: osmo-stp_10.42.42.5(pid=17588) [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17588)] [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 21:25:59.991175 tst handover.py:18: Test FAILED (7.9 sec) 21:26:00.020529 run osmo-hlr_10.42.42.2(pid=17585): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17585)] 21:26:00.073241 run osmo-hlr_10.42.42.2(pid=17585): stdout: | (launched: 2022-12-09_21:25:55.953371) 21:26:00.126898 run osmo-hlr_10.42.42.2(pid=17585): stderr: | 20221209212556206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212556207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212556207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212556207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212556207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212556207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212556236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212556244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212556257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212556257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:00.200931 run osmo-msc_10.42.42.6(pid=17591): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17591)] 21:26:00.252826 run osmo-msc_10.42.42.6(pid=17591): stdout: | (launched: 2022-12-09_21:25:58.551037) 21:26:00.306736 run osmo-msc_10.42.42.6(pid=17591): stderr: | 20221209212559085 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212559086 DLGLOBAL DEBUG validating counter group 0x7fd9ad668c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212559086 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212559086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212559086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212559086 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212559088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212559088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212559088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212559093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:00.360766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17584): Terminating (SIGTERM) 21:26:00.405453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17587): Terminating (SIGTERM) 21:26:00.451042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17590): Terminating (SIGTERM) 21:26:00.497436 --- ParallelTerminationStrategy: PID 17584 died... 21:26:00.518219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17584): Terminated: ok {rc=0} 21:26:00.568877 --- ParallelTerminationStrategy: PID 17587 died... 21:26:00.590240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17587): Terminated: ok {rc=0} 21:26:00.639570 --- ParallelTerminationStrategy: PID 17590 died... 21:26:00.660157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17590): Terminated: ok {rc=0} 21:26:00.752734 bus /sierra_3: Setting Powered False 21:26:01.873926 bus /sierra_3: Setting Powered False 21:26:02.999445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 21:26:04.259576 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:04.264754 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:26:04.334090 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:26:04.361838 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:26:04.421941 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:26:04.476384 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:26:04.520499 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:26:05.076923 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 21:26:05.087545 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:05.100096 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:26:05.137853 tst handover.py: using LAC 23835 21:26:05.285258 tst handover.py: using RAC 120 21:26:05.436190 tst handover.py: using CellId 23835 21:26:05.571377 tst handover.py: using BVCI 23836 21:26:05.698783 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:26:05.753115 tst handover.py: using LAC 23836 21:26:05.902206 tst handover.py: using RAC 121 21:26:06.048245 tst handover.py: using CellId 23836 21:26:06.193231 tst handover.py: using BVCI 23837 21:26:06.350960 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:06.363134 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:06.376281 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:06.388776 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:06.400726 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:26:06.413532 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:26:06.543933 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:26:06.680024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:07.187582 run create_hlr_db(pid=17596): Launched 21:26:07.369894 bus /sierra_2: Setting Powered False 21:26:08.434538 run create_hlr_db(pid=17596): Terminated: ok {rc=0} 21:26:08.885946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Launched 21:26:09.234755 run osmo-hlr_10.42.42.2(pid=17599): Launched 21:26:09.486649 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:10.135780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Launched 21:26:10.481559 run osmo-stp_10.42.42.5(pid=17602): Launched 21:26:10.767319 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:11.371835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17604): Launched 21:26:11.757879 run osmo-msc_10.42.42.6(pid=17605): Launched 21:26:12.137777 run osmo-stp_10.42.42.5(pid=17602): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] 21:26:12.420882 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-09_21:26:10.420349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:12.591474 run osmo-stp_10.42.42.5(pid=17602): stderr: | 20221209212610664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212610664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212610664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212610665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212610665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212610665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212610665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:12.732922 run osmo-stp_10.42.42.5(pid=17602): stdout: | (launched: 2022-12-09_21:26:10.420349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:12.866645 run osmo-stp_10.42.42.5(pid=17602): stderr: | 20221209212610664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212610664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212610664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212610665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212610665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212610665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212610665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:13.027701 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 21:26:13.037151 tst handover.py:18: Test FAILED (7.9 sec) 21:26:13.065346 run osmo-hlr_10.42.42.2(pid=17599): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17599)] 21:26:13.117349 run osmo-hlr_10.42.42.2(pid=17599): stdout: | (launched: 2022-12-09_21:26:09.173829) 21:26:13.170713 run osmo-hlr_10.42.42.2(pid=17599): stderr: | 20221209212609477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212609477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212609477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212609477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212609477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212609477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212609503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212609516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212609516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212609517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:13.245724 run osmo-msc_10.42.42.6(pid=17605): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17605)] 21:26:13.297501 run osmo-msc_10.42.42.6(pid=17605): stdout: | (launched: 2022-12-09_21:26:11.695318) 21:26:13.352341 run osmo-msc_10.42.42.6(pid=17605): stderr: | 20221209212612200 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212612200 DLGLOBAL DEBUG validating counter group 0x7f1ddfaadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212612200 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212612200 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212612209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212612209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212612211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212612211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212612212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212612212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:13.405979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminating (SIGTERM) 21:26:13.449105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminating (SIGTERM) 21:26:13.494306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17604): Terminating (SIGTERM) 21:26:13.540562 --- ParallelTerminationStrategy: PID 17598 died... 21:26:13.561554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17598): Terminated: ok {rc=0} 21:26:13.610771 --- ParallelTerminationStrategy: PID 17601 died... 21:26:13.631159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17601): Terminated: ok {rc=0} 21:26:13.679099 --- ParallelTerminationStrategy: PID 17604 died... 21:26:13.699608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17604): Terminated: ok {rc=0} 21:26:13.795609 bus /sierra_3: Setting Powered False 21:26:14.894954 bus /sierra_3: Setting Powered False 21:26:16.017387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 21:26:17.340320 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:17.351665 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:26:17.418246 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:26:17.453604 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:26:17.512725 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:26:17.568405 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:26:17.598135 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:26:18.150423 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 21:26:18.156138 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:18.167649 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:26:18.217103 tst handover.py: using LAC 23837 21:26:18.353679 tst handover.py: using RAC 122 21:26:18.509530 tst handover.py: using CellId 23837 21:26:18.642226 tst handover.py: using BVCI 23838 21:26:18.777342 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:26:18.833283 tst handover.py: using LAC 23838 21:26:18.962660 tst handover.py: using RAC 123 21:26:19.099620 tst handover.py: using CellId 23838 21:26:19.231152 tst handover.py: using BVCI 23839 21:26:19.355549 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:19.367285 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:19.378820 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:19.391112 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:19.403622 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:26:19.417246 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:26:19.556738 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:26:19.679177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:20.148186 run create_hlr_db(pid=17610): Launched 21:26:20.299160 bus /sierra_2: Setting Powered False 21:26:21.365154 run create_hlr_db(pid=17610): Terminated: ok {rc=0} 21:26:21.830771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Launched 21:26:22.182296 run osmo-hlr_10.42.42.2(pid=17613): Launched 21:26:22.462940 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:23.057635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Launched 21:26:23.389335 run osmo-stp_10.42.42.5(pid=17616): Launched 21:26:23.537714 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:24.253786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17618): Launched 21:26:24.600003 run osmo-msc_10.42.42.6(pid=17619): Launched 21:26:24.919721 run osmo-stp_10.42.42.5(pid=17616): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] 21:26:25.127568 run osmo-stp_10.42.42.5(pid=17616): stdout: | (launched: 2022-12-09_21:26:23.330744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:25.404855 run osmo-stp_10.42.42.5(pid=17616): stderr: | 20221209212623665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212623665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212623666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212623666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212623666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212623666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212623667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:25.541872 run osmo-stp_10.42.42.5(pid=17616): stdout: | (launched: 2022-12-09_21:26:23.330744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:25.667859 run osmo-stp_10.42.42.5(pid=17616): stderr: | 20221209212623665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212623665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212623666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212623666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212623666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212623666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212623667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:25.818623 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17616): Process ended prematurely: osmo-stp_10.42.42.5(pid=17616) [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 21:26:25.827410 tst handover.py:18: Test FAILED (7.7 sec) 21:26:25.855575 run osmo-hlr_10.42.42.2(pid=17613): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17613)] 21:26:25.905140 run osmo-hlr_10.42.42.2(pid=17613): stdout: | (launched: 2022-12-09_21:26:22.118212) 21:26:25.956463 run osmo-hlr_10.42.42.2(pid=17613): stderr: | 20221209212622374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212622374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212622374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212622374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212622374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212622374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212622400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212622416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212622416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212622425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:26.027171 run osmo-msc_10.42.42.6(pid=17619): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17619)] 21:26:26.076356 run osmo-msc_10.42.42.6(pid=17619): stdout: | (launched: 2022-12-09_21:26:24.538520) 21:26:26.127327 run osmo-msc_10.42.42.6(pid=17619): stderr: | 20221209212625001 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212625001 DLGLOBAL DEBUG validating counter group 0x7f0f22317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212625001 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212625001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212625001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212625002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212625003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212625004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212625004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212625004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:26.178031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Terminating (SIGTERM) 21:26:26.219463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Terminating (SIGTERM) 21:26:26.261468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17618): Terminating (SIGTERM) 21:26:26.304678 --- ParallelTerminationStrategy: PID 17612 died... 21:26:26.324232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17612): Terminated: ok {rc=0} 21:26:26.372262 --- ParallelTerminationStrategy: PID 17615 died... 21:26:26.391943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17615): Terminated: ok {rc=0} 21:26:26.439247 --- ParallelTerminationStrategy: PID 17618 died... 21:26:26.458826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17618): Terminated: ok {rc=0} 21:26:26.548046 bus /sierra_3: Setting Powered False 21:26:27.663452 bus /sierra_3: Setting Powered False 21:26:28.809332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 21:26:30.088130 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:30.094207 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 21:26:30.155223 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 21:26:30.183685 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 21:26:30.234960 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 21:26:30.311985 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 21:26:30.349744 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 21:26:30.896675 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 21:26:30.903528 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:30.916639 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:26:30.989124 tst handover.py: using LAC 23839 21:26:31.117052 tst handover.py: using RAC 124 21:26:31.242282 tst handover.py: using CellId 23839 21:26:31.371406 tst handover.py: using BVCI 23840 21:26:31.490845 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 21:26:31.539029 tst handover.py: using LAC 23840 21:26:31.670111 tst handover.py: using RAC 125 21:26:31.796800 tst handover.py: using CellId 23840 21:26:31.940342 tst handover.py: using BVCI 23841 21:26:32.057934 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:32.070098 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:32.083123 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:32.095103 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:32.109546 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 21:26:32.122592 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:26:32.242906 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 21:26:32.373788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:32.987780 run create_hlr_db(pid=17624): Launched 21:26:33.183168 bus /sierra_2: Setting Powered False 21:26:34.245542 run create_hlr_db(pid=17624): Terminated: ok {rc=0} 21:26:34.664186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17626): Launched 21:26:34.987727 run osmo-hlr_10.42.42.2(pid=17627): Launched 21:26:35.199898 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:35.758635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17629): Launched 21:26:36.090817 run osmo-stp_10.42.42.5(pid=17630): Launched 21:26:36.343935 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:36.985714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17632): Launched 21:26:37.372746 run osmo-msc_10.42.42.6(pid=17633): Launched 21:26:37.741203 run osmo-stp_10.42.42.5(pid=17630): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17630)] 21:26:37.979869 run osmo-stp_10.42.42.5(pid=17630): stdout: | (launched: 2022-12-09_21:26:36.026586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:38.239769 run osmo-stp_10.42.42.5(pid=17630): stderr: | 20221209212636268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212636268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212636268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212636268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212636269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212636269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212636269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:38.381457 run osmo-stp_10.42.42.5(pid=17630): stdout: | (launched: 2022-12-09_21:26:36.026586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:38.515111 run osmo-stp_10.42.42.5(pid=17630): stderr: | 20221209212636268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212636268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212636268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212636268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212636269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212636269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212636269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:38.677144 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17630): Process ended prematurely: osmo-stp_10.42.42.5(pid=17630) [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17630)] [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 21:26:38.686827 tst handover.py:18: Test FAILED (7.8 sec) 21:26:38.715650 run osmo-hlr_10.42.42.2(pid=17627): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17627)] 21:26:38.768308 run osmo-hlr_10.42.42.2(pid=17627): stdout: | (launched: 2022-12-09_21:26:34.929690) 21:26:38.822816 run osmo-hlr_10.42.42.2(pid=17627): stderr: | 20221209212635210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212635210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212635210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212635210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212635210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212635210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212635228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212635245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212635245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212635245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:38.897215 run osmo-msc_10.42.42.6(pid=17633): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17633)] 21:26:38.948807 run osmo-msc_10.42.42.6(pid=17633): stdout: | (launched: 2022-12-09_21:26:37.309934) 21:26:39.002849 run osmo-msc_10.42.42.6(pid=17633): stderr: | 20221209212637814 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212637814 DLGLOBAL DEBUG validating counter group 0x7f679c576c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212637815 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212637815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212637815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212637815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212637817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212637817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212637817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212637817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:39.057756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17626): Terminating (SIGTERM) 21:26:39.101603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17629): Terminating (SIGTERM) 21:26:39.146555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17632): Terminating (SIGTERM) 21:26:39.192659 --- ParallelTerminationStrategy: PID 17626 died... 21:26:39.213199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17626): Terminated: ok {rc=0} 21:26:39.261902 --- ParallelTerminationStrategy: PID 17629 died... 21:26:39.282265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17629): Terminated: ok {rc=0} 21:26:39.330477 --- ParallelTerminationStrategy: PID 17632 died... 21:26:39.351495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17632): Terminated: ok {rc=0} 21:26:39.442315 bus /sierra_3: Setting Powered False 21:26:40.553916 bus /sierra_3: Setting Powered False 21:26:41.689742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:26:43.022547 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:43.032198 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:26:43.098560 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:26:43.126109 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:26:43.180461 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:26:43.268330 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:26:43.295912 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:26:43.819799 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:26:43.826570 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:43.838417 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:26:43.893271 tst handover.py: using LAC 23841 21:26:44.016597 tst handover.py: using RAC 126 21:26:44.151826 tst handover.py: using CellId 23841 21:26:44.297337 tst handover.py: using BVCI 23842 21:26:44.440029 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:26:44.490608 tst handover.py: using LAC 23842 21:26:44.638494 tst handover.py: using RAC 127 21:26:44.769509 tst handover.py: using CellId 23842 21:26:44.901660 tst handover.py: using BVCI 23843 21:26:45.026145 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:45.038409 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:45.050528 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:45.062743 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:45.074503 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:26:45.086730 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:26:45.211217 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:26:45.344011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:45.839359 run create_hlr_db(pid=17638): Launched 21:26:46.071145 bus /sierra_2: Setting Powered False 21:26:47.160207 run create_hlr_db(pid=17638): Terminated: ok {rc=0} 21:26:47.601782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Launched 21:26:47.956414 run osmo-hlr_10.42.42.2(pid=17641): Launched 21:26:48.210007 run osmo-stp_10.42.42.5: Starting osmo-stp 21:26:48.824169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Launched 21:26:49.155581 run osmo-stp_10.42.42.5(pid=17644): Launched 21:26:49.408462 run osmo-msc_10.42.42.6: Starting osmo-msc 21:26:50.054080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Launched 21:26:50.409697 run osmo-msc_10.42.42.6(pid=17647): Launched 21:26:50.788693 run osmo-stp_10.42.42.5(pid=17644): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] 21:26:51.107604 run osmo-stp_10.42.42.5(pid=17644): stdout: | (launched: 2022-12-09_21:26:49.093850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:51.327853 run osmo-stp_10.42.42.5(pid=17644): stderr: | 20221209212649395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212649395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212649396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212649396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212649396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212649397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212649397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:51.468383 run osmo-stp_10.42.42.5(pid=17644): stdout: | (launched: 2022-12-09_21:26:49.093850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:26:51.603144 run osmo-stp_10.42.42.5(pid=17644): stderr: | 20221209212649395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212649395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212649396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212649396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212649396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212649397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212649397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:26:51.765888 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17644): Process ended prematurely: osmo-stp_10.42.42.5(pid=17644) [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 21:26:51.776088 tst handover.py:18: Test FAILED (7.9 sec) 21:26:51.805701 run osmo-hlr_10.42.42.2(pid=17641): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17641)] 21:26:51.860934 run osmo-hlr_10.42.42.2(pid=17641): stdout: | (launched: 2022-12-09_21:26:47.895517) 21:26:51.915360 run osmo-hlr_10.42.42.2(pid=17641): stderr: | 20221209212648202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212648203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212648203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212648203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212648203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212648203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212648224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212648240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212648240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212648240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:26:51.990554 run osmo-msc_10.42.42.6(pid=17647): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17647)] 21:26:52.043248 run osmo-msc_10.42.42.6(pid=17647): stdout: | (launched: 2022-12-09_21:26:50.342856) 21:26:52.097862 run osmo-msc_10.42.42.6(pid=17647): stderr: | 20221209212650900 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212650900 DLGLOBAL DEBUG validating counter group 0x7f735416bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212650900 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212650900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212650901 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212650901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212650902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212650903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212650903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212650903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:26:52.151890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Terminating (SIGTERM) 21:26:52.195439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Terminating (SIGTERM) 21:26:52.240635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Terminating (SIGTERM) 21:26:52.286505 --- ParallelTerminationStrategy: PID 17640 died... 21:26:52.307368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17640): Terminated: ok {rc=0} 21:26:52.356818 --- ParallelTerminationStrategy: PID 17643 died... 21:26:52.377446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17643): Terminated: ok {rc=0} 21:26:52.425623 --- ParallelTerminationStrategy: PID 17646 died... 21:26:52.445945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17646): Terminated: ok {rc=0} 21:26:52.537436 bus /sierra_3: Setting Powered False 21:26:53.638711 bus /sierra_3: Setting Powered False 21:26:54.758467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 21:26:56.045765 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:26:56.051737 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:26:56.105667 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:26:56.134207 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:26:56.184360 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:26:56.236812 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:26:56.265552 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:26:56.826468 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 21:26:56.833510 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:56.845644 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 21:26:56.905280 tst handover.py: using LAC 23843 21:26:57.036274 tst handover.py: using RAC 128 21:26:57.167735 tst handover.py: using CellId 23843 21:26:57.301744 tst handover.py: using BVCI 23844 21:26:57.428911 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 21:26:57.465186 tst handover.py: using LAC 23844 21:26:57.620287 tst handover.py: using RAC 129 21:26:57.751877 tst handover.py: using CellId 23844 21:26:57.891835 tst handover.py: using BVCI 23845 21:26:58.019724 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:58.031353 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:58.043099 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:58.054810 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:58.066716 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:26:58.078514 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 21:26:58.200311 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 21:26:58.326836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:26:58.820102 run create_hlr_db(pid=17652): Launched 21:26:58.986042 bus /sierra_2: Setting Powered False 21:27:00.054990 run create_hlr_db(pid=17652): Terminated: ok {rc=0} 21:27:00.565768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17654): Launched 21:27:00.920614 run osmo-hlr_10.42.42.2(pid=17655): Launched 21:27:01.173435 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:01.871048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17657): Launched 21:27:02.221660 run osmo-stp_10.42.42.5(pid=17658): Launched 21:27:02.524347 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:03.211310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17660): Launched 21:27:03.562649 run osmo-msc_10.42.42.6(pid=17661): Launched 21:27:03.936875 run osmo-stp_10.42.42.5(pid=17658): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17658)] 21:27:04.128369 run osmo-stp_10.42.42.5(pid=17658): stdout: | (launched: 2022-12-09_21:27:02.156126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:04.350433 run osmo-stp_10.42.42.5(pid=17658): stderr: | 20221209212702447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212702447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212702448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212702448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212702455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212702455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212702455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:04.492889 run osmo-stp_10.42.42.5(pid=17658): stdout: | (launched: 2022-12-09_21:27:02.156126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:04.629435 run osmo-stp_10.42.42.5(pid=17658): stderr: | 20221209212702447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212702447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212702448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212702448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212702455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212702455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212702455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:04.791456 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17658): Process ended prematurely: osmo-stp_10.42.42.5(pid=17658) [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17658)] [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 21:27:04.801222 tst handover.py:18: Test FAILED (8.0 sec) 21:27:04.830945 run osmo-hlr_10.42.42.2(pid=17655): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17655)] 21:27:04.883770 run osmo-hlr_10.42.42.2(pid=17655): stdout: | (launched: 2022-12-09_21:27:00.859064) 21:27:04.937137 run osmo-hlr_10.42.42.2(pid=17655): stderr: | 20221209212701161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212701161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212701161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212701161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212701161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212701161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212701183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212701191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212701191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212701191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:05.012199 run osmo-msc_10.42.42.6(pid=17661): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17661)] 21:27:05.064651 run osmo-msc_10.42.42.6(pid=17661): stdout: | (launched: 2022-12-09_21:27:03.500941) 21:27:05.129780 run osmo-msc_10.42.42.6(pid=17661): stderr: | 20221209212704006 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212704006 DLGLOBAL DEBUG validating counter group 0x7f8d5d858c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212704006 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212704006 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212704007 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212704007 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212704017 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212704017 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212704017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212704017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:05.184426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17654): Terminating (SIGTERM) 21:27:05.228018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17657): Terminating (SIGTERM) 21:27:05.272913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17660): Terminating (SIGTERM) 21:27:05.318075 --- ParallelTerminationStrategy: PID 17654 died... 21:27:05.338686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17654): Terminated: ok {rc=0} 21:27:05.387721 --- ParallelTerminationStrategy: PID 17657 died... 21:27:05.408104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17657): Terminated: ok {rc=0} 21:27:05.455880 --- ParallelTerminationStrategy: PID 17660 died... 21:27:05.476435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17660): Terminated: ok {rc=0} 21:27:05.567225 bus /sierra_3: Setting Powered False 21:27:06.686684 bus /sierra_3: Setting Powered False 21:27:07.811396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 21:27:09.098873 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:09.104831 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:27:09.170250 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:27:09.199168 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:27:09.258148 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:27:09.338327 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:27:09.366235 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:27:09.905649 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 21:27:09.912563 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:09.924834 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:27:09.974542 tst handover.py: using LAC 23845 21:27:10.144843 tst handover.py: using RAC 130 21:27:10.271582 tst handover.py: using CellId 23845 21:27:10.413025 tst handover.py: using BVCI 23846 21:27:10.553456 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:27:10.605154 tst handover.py: using LAC 23846 21:27:10.735864 tst handover.py: using RAC 131 21:27:10.877104 tst handover.py: using CellId 23846 21:27:11.007095 tst handover.py: using BVCI 23847 21:27:11.128567 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:11.140794 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:11.152942 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:11.165368 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:11.177433 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:27:11.190243 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:27:11.314143 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:27:11.439433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:11.909887 run create_hlr_db(pid=17666): Launched 21:27:12.065345 bus /sierra_2: Setting Powered False 21:27:13.129067 run create_hlr_db(pid=17666): Terminated: ok {rc=0} 21:27:13.551681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Launched 21:27:13.881279 run osmo-hlr_10.42.42.2(pid=17669): Launched 21:27:14.033312 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:14.737295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Launched 21:27:15.057660 run osmo-stp_10.42.42.5(pid=17672): Launched 21:27:15.249259 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:15.976814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17674): Launched 21:27:16.358315 run osmo-msc_10.42.42.6(pid=17675): Launched 21:27:16.658092 run osmo-stp_10.42.42.5(pid=17672): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] 21:27:16.921395 run osmo-stp_10.42.42.5(pid=17672): stdout: | (launched: 2022-12-09_21:27:14.995138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:17.243767 run osmo-stp_10.42.42.5(pid=17672): stderr: | 20221209212715261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212715261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212715261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212715262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212715262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212715262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212715262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:17.440331 run osmo-stp_10.42.42.5(pid=17672): stdout: | (launched: 2022-12-09_21:27:14.995138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:17.576682 run osmo-stp_10.42.42.5(pid=17672): stderr: | 20221209212715261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212715261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212715261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212715262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212715262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212715262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212715262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:17.740661 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17672): Process ended prematurely: osmo-stp_10.42.42.5(pid=17672) [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 21:27:17.750206 tst handover.py:18: Test FAILED (7.8 sec) 21:27:17.785103 run osmo-hlr_10.42.42.2(pid=17669): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17669)] 21:27:17.847908 run osmo-hlr_10.42.42.2(pid=17669): stdout: | (launched: 2022-12-09_21:27:13.822259) 21:27:17.908568 run osmo-hlr_10.42.42.2(pid=17669): stderr: | 20221209212714102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212714102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212714102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212714102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212714102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212714102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212714115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212714128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212714128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212714128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:17.990725 run osmo-msc_10.42.42.6(pid=17675): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17675)] 21:27:18.050675 run osmo-msc_10.42.42.6(pid=17675): stdout: | (launched: 2022-12-09_21:27:16.296377) 21:27:18.111596 run osmo-msc_10.42.42.6(pid=17675): stderr: | 20221209212716906 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212716906 DLGLOBAL DEBUG validating counter group 0x7f4930a4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212716906 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212716906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212716906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212716907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212716908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212716917 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212716918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212716918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:18.166600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Terminating (SIGTERM) 21:27:18.209809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Terminating (SIGTERM) 21:27:18.254625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17674): Terminating (SIGTERM) 21:27:18.297974 --- ParallelTerminationStrategy: PID 17668 died... 21:27:18.318485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Terminated: ok {rc=0} 21:27:18.367058 --- ParallelTerminationStrategy: PID 17671 died... 21:27:18.387010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Terminated: ok {rc=0} 21:27:18.434821 --- ParallelTerminationStrategy: PID 17674 died... 21:27:18.454592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17674): Terminated: ok {rc=0} 21:27:18.543704 bus /sierra_3: Setting Powered False 21:27:19.663429 bus /sierra_3: Setting Powered False 21:27:20.818741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 21:27:22.124564 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:22.134647 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:27:22.226839 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:27:22.263128 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:27:22.317795 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:27:22.417869 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:27:22.445635 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:27:22.992869 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 21:27:22.998354 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:23.009789 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:23.061947 tst handover.py: using LAC 23847 21:27:23.197151 tst handover.py: using RAC 132 21:27:23.326331 tst handover.py: using CellId 23847 21:27:23.457259 tst handover.py: using BVCI 23848 21:27:23.575278 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:27:23.626564 tst handover.py: using LAC 23848 21:27:23.754752 tst handover.py: using RAC 133 21:27:23.886123 tst handover.py: using CellId 23848 21:27:24.039591 tst handover.py: using BVCI 23849 21:27:24.176614 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:24.188474 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:24.200214 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:24.213406 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:24.226942 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:27:24.239748 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:24.362049 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:27:24.499170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:24.967818 run create_hlr_db(pid=17680): Launched 21:27:25.123333 bus /sierra_2: Setting Powered False 21:27:26.217225 run create_hlr_db(pid=17680): Terminated: ok {rc=0} 21:27:26.752419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Launched 21:27:27.099627 run osmo-hlr_10.42.42.2(pid=17683): Launched 21:27:27.348020 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:27.999791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Launched 21:27:28.347492 run osmo-stp_10.42.42.5(pid=17686): Launched 21:27:28.600236 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:29.257333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Launched 21:27:29.653677 run osmo-msc_10.42.42.6(pid=17689): Launched 21:27:30.001244 run osmo-stp_10.42.42.5(pid=17686): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] 21:27:30.190541 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-09_21:27:28.286455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:30.422501 run osmo-stp_10.42.42.5(pid=17686): stderr: | 20221209212728574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212728574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212728574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212728574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212728575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212728575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212728575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:30.576499 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-09_21:27:28.286455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:30.713474 run osmo-stp_10.42.42.5(pid=17686): stderr: | 20221209212728574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212728574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212728574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212728574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212728575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212728575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212728575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:30.908202 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 21:27:30.917578 tst handover.py:18: Test FAILED (7.9 sec) 21:27:30.959159 run osmo-hlr_10.42.42.2(pid=17683): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17683)] 21:27:31.016232 run osmo-hlr_10.42.42.2(pid=17683): stdout: | (launched: 2022-12-09_21:27:27.038332) 21:27:31.069747 run osmo-hlr_10.42.42.2(pid=17683): stderr: | 20221209212727340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212727340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212727340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212727340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212727340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212727349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212727360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212727373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212727373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212727373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:31.145043 run osmo-msc_10.42.42.6(pid=17689): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17689)] 21:27:31.197682 run osmo-msc_10.42.42.6(pid=17689): stdout: | (launched: 2022-12-09_21:27:29.584884) 21:27:31.251625 run osmo-msc_10.42.42.6(pid=17689): stderr: | 20221209212730126 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212730127 DLGLOBAL DEBUG validating counter group 0x7fd6bf88cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212730127 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212730127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212730127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212730127 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212730129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212730129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212730129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212730130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:31.306184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Terminating (SIGTERM) 21:27:31.350345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminating (SIGTERM) 21:27:31.397088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminating (SIGTERM) 21:27:31.442885 --- ParallelTerminationStrategy: PID 17682 died... 21:27:31.463401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Terminated: ok {rc=0} 21:27:31.511400 --- ParallelTerminationStrategy: PID 17685 died... 21:27:31.535941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminated: ok {rc=0} 21:27:31.588076 --- ParallelTerminationStrategy: PID 17688 died... 21:27:31.613585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminated: ok {rc=0} 21:27:31.709759 bus /sierra_3: Setting Powered False 21:27:32.820602 bus /sierra_3: Setting Powered False 21:27:33.966073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 21:27:35.315671 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:35.322080 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 21:27:35.384047 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 21:27:35.413455 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 21:27:35.469272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 21:27:35.552417 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 21:27:35.581705 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 21:27:36.116891 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 21:27:36.123841 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:36.136502 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:27:36.185679 tst handover.py: using LAC 23849 21:27:36.321662 tst handover.py: using RAC 134 21:27:36.459362 tst handover.py: using CellId 23849 21:27:36.606591 tst handover.py: using BVCI 23850 21:27:36.742437 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 21:27:36.802393 tst handover.py: using LAC 23850 21:27:36.934747 tst handover.py: using RAC 135 21:27:37.064320 tst handover.py: using CellId 23850 21:27:37.209231 tst handover.py: using BVCI 23851 21:27:37.346260 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:37.358690 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:37.371713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:37.385842 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:37.400586 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 21:27:37.413831 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:27:37.541964 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 21:27:37.673881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:38.172384 run create_hlr_db(pid=17696): Launched 21:27:38.339433 bus /sierra_2: Setting Powered False 21:27:39.409793 run create_hlr_db(pid=17696): Terminated: ok {rc=0} 21:27:39.861662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17698): Launched 21:27:40.242234 run osmo-hlr_10.42.42.2(pid=17699): Launched 21:27:40.379638 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:40.971166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17701): Launched 21:27:41.337931 run osmo-stp_10.42.42.5(pid=17702): Launched 21:27:41.640625 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:42.408685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17704): Launched 21:27:42.801761 run osmo-msc_10.42.42.6(pid=17705): Launched 21:27:43.178497 run osmo-stp_10.42.42.5(pid=17702): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17702)] 21:27:43.339887 run osmo-stp_10.42.42.5(pid=17702): stdout: | (launched: 2022-12-09_21:27:41.265446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:43.504576 run osmo-stp_10.42.42.5(pid=17702): stderr: | 20221209212741668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212741668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212741669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212741669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212741669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212741670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212741670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:43.665667 run osmo-stp_10.42.42.5(pid=17702): stdout: | (launched: 2022-12-09_21:27:41.265446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:43.819550 run osmo-stp_10.42.42.5(pid=17702): stderr: | 20221209212741668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212741668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212741669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212741669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212741669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212741670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212741670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:44.006122 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17702): Process ended prematurely: osmo-stp_10.42.42.5(pid=17702) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17702)] [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 21:27:44.017151 tst handover.py:18: Test FAILED (7.9 sec) 21:27:44.055400 run osmo-hlr_10.42.42.2(pid=17699): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17699)] 21:27:44.115793 run osmo-hlr_10.42.42.2(pid=17699): stdout: | (launched: 2022-12-09_21:27:40.172452) 21:27:44.177531 run osmo-hlr_10.42.42.2(pid=17699): stderr: | 20221209212740531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212740531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212740531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212740531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212740531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212740531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212740568 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212740582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212740582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212740582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:44.259712 run osmo-msc_10.42.42.6(pid=17705): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17705)] 21:27:44.317763 run osmo-msc_10.42.42.6(pid=17705): stdout: | (launched: 2022-12-09_21:27:42.737238) 21:27:44.375266 run osmo-msc_10.42.42.6(pid=17705): stderr: | 20221209212743018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212743018 DLGLOBAL DEBUG validating counter group 0x7f0f6bc26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212743019 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212743019 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212743019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212743019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212743021 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212743021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212743021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212743021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:44.434205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17698): Terminating (SIGTERM) 21:27:44.480984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17701): Terminating (SIGTERM) 21:27:44.528237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17704): Terminating (SIGTERM) 21:27:44.576294 --- ParallelTerminationStrategy: PID 17698 died... 21:27:44.598336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17698): Terminated: ok {rc=0} 21:27:44.651489 --- ParallelTerminationStrategy: PID 17701 died... 21:27:44.673758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17701): Terminated: ok {rc=0} 21:27:44.724852 --- ParallelTerminationStrategy: PID 17704 died... 21:27:44.746280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17704): Terminated: ok {rc=0} 21:27:44.846005 bus /sierra_3: Setting Powered False 21:27:45.970417 bus /sierra_3: Setting Powered False 21:27:47.116878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 21:27:48.415837 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:27:48.422788 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:27:48.476186 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:27:48.504696 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:27:48.561138 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:27:48.620006 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:27:48.653973 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:27:49.211115 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 21:27:49.220473 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:49.235138 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 21:27:49.293017 tst handover.py: using LAC 23851 21:27:49.447575 tst handover.py: using RAC 136 21:27:49.607438 tst handover.py: using CellId 23851 21:27:49.756857 tst handover.py: using BVCI 23852 21:27:49.899671 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 21:27:49.937330 tst handover.py: using LAC 23852 21:27:50.076119 tst handover.py: using RAC 137 21:27:50.227197 tst handover.py: using CellId 23852 21:27:50.377360 tst handover.py: using BVCI 23853 21:27:50.502086 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:50.513713 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:50.525086 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:50.536924 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:50.548820 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:27:50.560247 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 21:27:50.688284 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 21:27:50.855977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:27:51.381060 run create_hlr_db(pid=17710): Launched 21:27:51.550029 bus /sierra_2: Setting Powered False 21:27:52.615161 run create_hlr_db(pid=17710): Terminated: ok {rc=0} 21:27:53.080047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17712): Launched 21:27:53.448477 run osmo-hlr_10.42.42.2(pid=17713): Launched 21:27:53.590330 run osmo-stp_10.42.42.5: Starting osmo-stp 21:27:54.177500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17715): Launched 21:27:54.518254 run osmo-stp_10.42.42.5(pid=17716): Launched 21:27:54.816037 run osmo-msc_10.42.42.6: Starting osmo-msc 21:27:55.530232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17718): Launched 21:27:55.915608 run osmo-msc_10.42.42.6(pid=17719): Launched 21:27:56.308414 run osmo-stp_10.42.42.5(pid=17716): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17716)] 21:27:56.630376 run osmo-stp_10.42.42.5(pid=17716): stdout: | (launched: 2022-12-09_21:27:54.453913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:56.795506 run osmo-stp_10.42.42.5(pid=17716): stderr: | 20221209212754831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212754831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212754832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212754832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212754837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212754837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212754837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:56.968034 run osmo-stp_10.42.42.5(pid=17716): stdout: | (launched: 2022-12-09_21:27:54.453913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:27:57.125281 run osmo-stp_10.42.42.5(pid=17716): stderr: | 20221209212754831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212754831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212754832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212754832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212754837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212754837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212754837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:27:57.313257 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17716): Process ended prematurely: osmo-stp_10.42.42.5(pid=17716) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17716)] [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 21:27:57.323586 tst handover.py:18: Test FAILED (8.1 sec) 21:27:57.356369 run osmo-hlr_10.42.42.2(pid=17713): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17713)] 21:27:57.407156 run osmo-hlr_10.42.42.2(pid=17713): stdout: | (launched: 2022-12-09_21:27:53.385776) 21:27:57.459606 run osmo-hlr_10.42.42.2(pid=17713): stderr: | 20221209212753597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212753597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212753597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212753597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212753597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212753597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212753612 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212753623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212753624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212753624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:27:57.533222 run osmo-msc_10.42.42.6(pid=17719): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17719)] 21:27:57.584435 run osmo-msc_10.42.42.6(pid=17719): stdout: | (launched: 2022-12-09_21:27:55.855309) 21:27:57.636709 run osmo-msc_10.42.42.6(pid=17719): stderr: | 20221209212756477 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212756478 DLGLOBAL DEBUG validating counter group 0x7fa21fbf0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212756478 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212756478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212756478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212756478 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212756480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212756480 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212756480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212756480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:27:57.689792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17712): Terminating (SIGTERM) 21:27:57.732668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17715): Terminating (SIGTERM) 21:27:57.775074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17718): Terminating (SIGTERM) 21:27:57.817600 --- ParallelTerminationStrategy: PID 17712 died... 21:27:57.837409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17712): Terminated: ok {rc=0} 21:27:57.884431 --- ParallelTerminationStrategy: PID 17715 died... 21:27:57.904457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17715): Terminated: ok {rc=0} 21:27:57.951240 --- ParallelTerminationStrategy: PID 17718 died... 21:27:57.971139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17718): Terminated: ok {rc=0} 21:27:58.061415 bus /sierra_3: Setting Powered False 21:27:59.171735 bus /sierra_3: Setting Powered False 21:28:00.305364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 21:28:01.608047 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:01.614360 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:28:01.693963 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:28:01.726183 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:28:01.791840 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:28:01.872523 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:28:01.906476 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:28:02.482619 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 21:28:02.491870 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:02.508116 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:02.556094 tst handover.py: using LAC 23853 21:28:02.699168 tst handover.py: using RAC 138 21:28:02.863165 tst handover.py: using CellId 23853 21:28:02.998790 tst handover.py: using BVCI 23854 21:28:03.125327 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:03.179158 tst handover.py: using LAC 23854 21:28:03.318820 tst handover.py: using RAC 139 21:28:03.474781 tst handover.py: using CellId 23854 21:28:03.642834 tst handover.py: using BVCI 23855 21:28:03.787905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:03.800078 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:03.813064 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:03.827360 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:03.839475 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:03.853558 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:04.022776 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:04.167695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:04.701883 run create_hlr_db(pid=17724): Launched 21:28:04.871211 bus /sierra_2: Setting Powered False 21:28:05.936847 run create_hlr_db(pid=17724): Terminated: ok {rc=0} 21:28:06.375478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Launched 21:28:06.716478 run osmo-hlr_10.42.42.2(pid=17727): Launched 21:28:06.880011 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:07.435793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Launched 21:28:07.781931 run osmo-stp_10.42.42.5(pid=17730): Launched 21:28:07.963401 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:08.570147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Launched 21:28:08.919565 run osmo-msc_10.42.42.6(pid=17733): Launched 21:28:09.313750 run osmo-stp_10.42.42.5(pid=17730): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] 21:28:09.594793 run osmo-stp_10.42.42.5(pid=17730): stdout: | (launched: 2022-12-09_21:28:07.710839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:09.840087 run osmo-stp_10.42.42.5(pid=17730): stderr: | 20221209212807952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212807952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212807952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212807953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212807953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212807953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212807954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:09.996417 run osmo-stp_10.42.42.5(pid=17730): stdout: | (launched: 2022-12-09_21:28:07.710839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:10.130541 run osmo-stp_10.42.42.5(pid=17730): stderr: | 20221209212807952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212807952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212807952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212807953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212807953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212807953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212807954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:10.289245 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17730): Process ended prematurely: osmo-stp_10.42.42.5(pid=17730) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 21:28:10.298785 tst handover.py:18: Test FAILED (7.8 sec) 21:28:10.327198 run osmo-hlr_10.42.42.2(pid=17727): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17727)] 21:28:10.378016 run osmo-hlr_10.42.42.2(pid=17727): stdout: | (launched: 2022-12-09_21:28:06.653145) 21:28:10.431315 run osmo-hlr_10.42.42.2(pid=17727): stderr: | 20221209212806921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212806921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212806921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212806921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212806921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212806921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212806939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212806954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212806954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212806954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:10.505228 run osmo-msc_10.42.42.6(pid=17733): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17733)] 21:28:10.555909 run osmo-msc_10.42.42.6(pid=17733): stdout: | (launched: 2022-12-09_21:28:08.856500) 21:28:10.608480 run osmo-msc_10.42.42.6(pid=17733): stderr: | 20221209212809506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212809506 DLGLOBAL DEBUG validating counter group 0x7f76d35b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212809506 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212809506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212809506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212809507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212809508 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212809511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212809512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212809512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:10.661714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Terminating (SIGTERM) 21:28:10.704370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Terminating (SIGTERM) 21:28:10.747108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Terminating (SIGTERM) 21:28:10.790409 --- ParallelTerminationStrategy: PID 17726 died... 21:28:10.810777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17726): Terminated: ok {rc=0} 21:28:10.859258 --- ParallelTerminationStrategy: PID 17729 died... 21:28:10.879396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17729): Terminated: ok {rc=0} 21:28:10.927014 --- ParallelTerminationStrategy: PID 17732 died... 21:28:10.947477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17732): Terminated: ok {rc=0} 21:28:11.035262 bus /sierra_3: Setting Powered False 21:28:12.135312 bus /sierra_3: Setting Powered False 21:28:13.264474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 21:28:14.566339 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:14.573444 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:28:14.633500 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:28:14.662112 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:28:14.715146 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:28:14.775595 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:28:14.803148 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:28:15.396676 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 21:28:15.403631 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:15.418415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:15.480799 tst handover.py: using LAC 23855 21:28:15.631640 tst handover.py: using RAC 140 21:28:15.778003 tst handover.py: using CellId 23855 21:28:15.964596 tst handover.py: using BVCI 23856 21:28:16.096228 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:16.147114 tst handover.py: using LAC 23856 21:28:16.323341 tst handover.py: using RAC 141 21:28:16.489042 tst handover.py: using CellId 23856 21:28:16.680707 tst handover.py: using BVCI 23857 21:28:16.839034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:16.852879 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:16.865519 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:16.877907 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:16.890978 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:16.903477 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:17.059730 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:17.217350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:17.831470 run create_hlr_db(pid=17738): Launched 21:28:18.029401 bus /sierra_2: Setting Powered False 21:28:19.094140 run create_hlr_db(pid=17738): Terminated: ok {rc=0} 21:28:19.532493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Launched 21:28:19.870322 run osmo-hlr_10.42.42.2(pid=17741): Launched 21:28:19.998540 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:20.559445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Launched 21:28:20.912463 run osmo-stp_10.42.42.5(pid=17744): Launched 21:28:21.044714 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:21.652123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Launched 21:28:22.001673 run osmo-msc_10.42.42.6(pid=17758): Launched 21:28:22.199077 run osmo-stp_10.42.42.5(pid=17744): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] 21:28:22.339288 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-09_21:28:20.849180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:22.480151 run osmo-stp_10.42.42.5(pid=17744): stderr: | 20221209212821023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212821023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212821023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212821023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212821024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212821024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212821024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:22.619484 run osmo-stp_10.42.42.5(pid=17744): stdout: | (launched: 2022-12-09_21:28:20.849180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:22.752016 run osmo-stp_10.42.42.5(pid=17744): stderr: | 20221209212821023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212821023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212821023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212821023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212821024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212821024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212821024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:22.909855 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 21:28:22.918990 tst handover.py:18: Test FAILED (7.5 sec) 21:28:22.946936 run osmo-hlr_10.42.42.2(pid=17741): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17741)] 21:28:22.997237 run osmo-hlr_10.42.42.2(pid=17741): stdout: | (launched: 2022-12-09_21:28:19.808402) 21:28:23.049067 run osmo-hlr_10.42.42.2(pid=17741): stderr: | 20221209212820031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212820031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212820031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212820031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212820031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212820031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212820042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212820054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212820055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212820055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:23.121572 run osmo-msc_10.42.42.6(pid=17758): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17758)] 21:28:23.171642 run osmo-msc_10.42.42.6(pid=17758): stdout: | (launched: 2022-12-09_21:28:21.935484) 21:28:23.223422 run osmo-msc_10.42.42.6(pid=17758): stderr: | 20221209212822277 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212822277 DLGLOBAL DEBUG validating counter group 0x7fa853c14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212822277 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212822277 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212822278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212822278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212822279 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212822280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212822280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212822280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:23.275444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminating (SIGTERM) 21:28:23.317077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminating (SIGTERM) 21:28:23.358580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminating (SIGTERM) 21:28:23.400371 --- ParallelTerminationStrategy: PID 17740 died... 21:28:23.420625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17740): Terminated: ok {rc=0} 21:28:23.466793 --- ParallelTerminationStrategy: PID 17743 died... 21:28:23.486387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17743): Terminated: ok {rc=0} 21:28:23.532851 --- ParallelTerminationStrategy: PID 17746 died... 21:28:23.553049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17746): Terminated: ok {rc=0} 21:28:23.642258 bus /sierra_3: Setting Powered False 21:28:24.742404 bus /sierra_3: Setting Powered False 21:28:25.859066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 21:28:27.130404 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:27.135846 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 21:28:27.188169 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 21:28:27.215659 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 21:28:27.271268 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 21:28:27.323012 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 21:28:27.349590 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 21:28:27.901345 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 21:28:27.908252 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:27.920854 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 21:28:27.977725 tst handover.py: using LAC 23857 21:28:28.103767 tst handover.py: using RAC 142 21:28:28.235558 tst handover.py: using CellId 23857 21:28:28.364768 tst handover.py: using BVCI 23858 21:28:28.486487 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 21:28:28.526301 tst handover.py: using LAC 23858 21:28:28.670351 tst handover.py: using RAC 143 21:28:28.803208 tst handover.py: using CellId 23858 21:28:28.962366 tst handover.py: using BVCI 23859 21:28:29.116094 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:29.128458 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:29.141033 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:29.152677 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:29.164422 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 21:28:29.176565 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 21:28:29.324582 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 21:28:29.467643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:29.957929 run create_hlr_db(pid=17766): Launched 21:28:30.170098 bus /sierra_2: Setting Powered False 21:28:31.258159 run create_hlr_db(pid=17766): Terminated: ok {rc=0} 21:28:31.810493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17768): Launched 21:28:32.289787 run osmo-hlr_10.42.42.2(pid=17769): Launched 21:28:32.569887 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:33.331512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17771): Launched 21:28:33.678913 run osmo-stp_10.42.42.5(pid=17772): Launched 21:28:33.924356 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:34.728553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17774): Launched 21:28:35.100220 run osmo-msc_10.42.42.6(pid=17775): Launched 21:28:35.468923 run osmo-stp_10.42.42.5(pid=17772): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17772)] 21:28:35.740261 run osmo-stp_10.42.42.5(pid=17772): stdout: | (launched: 2022-12-09_21:28:33.617821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:35.916133 run osmo-stp_10.42.42.5(pid=17772): stderr: | 20221209212833908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212833908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212833908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212833917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212833917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212833917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212833917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:36.050069 run osmo-stp_10.42.42.5(pid=17772): stdout: | (launched: 2022-12-09_21:28:33.617821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:36.177382 run osmo-stp_10.42.42.5(pid=17772): stderr: | 20221209212833908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212833908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212833908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212833917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212833917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212833917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212833917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:36.330367 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17772): Process ended prematurely: osmo-stp_10.42.42.5(pid=17772) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17772)] [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 21:28:36.340237 tst handover.py:18: Test FAILED (8.4 sec) 21:28:36.371103 run osmo-hlr_10.42.42.2(pid=17769): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17769)] 21:28:36.422592 run osmo-hlr_10.42.42.2(pid=17769): stdout: | (launched: 2022-12-09_21:28:32.210632) 21:28:36.477230 run osmo-hlr_10.42.42.2(pid=17769): stderr: | 20221209212832561 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212832561 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212832561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212832561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212832561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212832561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212832579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212832592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212832592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212832592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:36.550801 run osmo-msc_10.42.42.6(pid=17775): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17775)] 21:28:36.602411 run osmo-msc_10.42.42.6(pid=17775): stdout: | (launched: 2022-12-09_21:28:35.032725) 21:28:36.656357 run osmo-msc_10.42.42.6(pid=17775): stderr: | 20221209212835523 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212835524 DLGLOBAL DEBUG validating counter group 0x7fee8b87fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212835524 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212835524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212835524 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212835524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212835530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212835531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212835531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212835531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:36.711231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17768): Terminating (SIGTERM) 21:28:36.754726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17771): Terminating (SIGTERM) 21:28:36.800095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17774): Terminating (SIGTERM) 21:28:36.847241 --- ParallelTerminationStrategy: PID 17768 died... 21:28:36.868929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17768): Terminated: ok {rc=0} 21:28:36.920132 --- ParallelTerminationStrategy: PID 17771 died... 21:28:36.940466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17771): Terminated: ok {rc=0} 21:28:36.988763 --- ParallelTerminationStrategy: PID 17774 died... 21:28:37.008523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17774): Terminated: ok {rc=0} 21:28:37.097479 bus /sierra_3: Setting Powered False 21:28:38.220052 bus /sierra_3: Setting Powered False 21:28:39.360449 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 21:28:40.662056 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:40.668125 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:28:40.772018 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:28:40.815258 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:28:40.907569 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:28:41.015571 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:28:41.044041 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:28:41.559497 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 21:28:41.566338 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:41.586555 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:41.666562 tst handover.py: using LAC 23859 21:28:41.802928 tst handover.py: using RAC 144 21:28:41.959056 tst handover.py: using CellId 23859 21:28:42.133271 tst handover.py: using BVCI 23860 21:28:42.254575 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:28:42.307474 tst handover.py: using LAC 23860 21:28:42.446675 tst handover.py: using RAC 145 21:28:42.597903 tst handover.py: using CellId 23860 21:28:42.764821 tst handover.py: using BVCI 23861 21:28:42.883897 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:42.896094 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:42.908701 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:42.922239 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:42.934773 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:28:42.946530 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:43.092822 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:28:43.254695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:43.716415 run create_hlr_db(pid=17780): Launched 21:28:43.876123 bus /sierra_2: Setting Powered False 21:28:44.967201 run create_hlr_db(pid=17780): Terminated: ok {rc=0} 21:28:45.461686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17782): Launched 21:28:45.813507 run osmo-hlr_10.42.42.2(pid=17783): Launched 21:28:45.953351 run osmo-stp_10.42.42.5: Starting osmo-stp 21:28:46.767109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17785): Launched 21:28:47.135394 run osmo-stp_10.42.42.5(pid=17786): Launched 21:28:47.343236 run osmo-msc_10.42.42.6: Starting osmo-msc 21:28:48.129449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17788): Launched 21:28:48.481656 run osmo-msc_10.42.42.6(pid=17789): Launched 21:28:48.874520 run osmo-stp_10.42.42.5(pid=17786): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17786)] 21:28:49.219958 run osmo-stp_10.42.42.5(pid=17786): stdout: | (launched: 2022-12-09_21:28:47.070318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:49.449841 run osmo-stp_10.42.42.5(pid=17786): stderr: | 20221209212847474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212847474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212847474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212847474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212847475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212847475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212847475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:49.581208 run osmo-stp_10.42.42.5(pid=17786): stdout: | (launched: 2022-12-09_21:28:47.070318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:28:49.707731 run osmo-stp_10.42.42.5(pid=17786): stderr: | 20221209212847474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212847474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212847474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212847474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212847475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212847475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212847475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:28:49.858521 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17786): Process ended prematurely: osmo-stp_10.42.42.5(pid=17786) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17786)] [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 21:28:49.867293 tst handover.py:18: Test FAILED (8.3 sec) 21:28:49.896380 run osmo-hlr_10.42.42.2(pid=17783): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17783)] 21:28:49.946081 run osmo-hlr_10.42.42.2(pid=17783): stdout: | (launched: 2022-12-09_21:28:45.751950) 21:28:49.997153 run osmo-hlr_10.42.42.2(pid=17783): stderr: | 20221209212846139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212846139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212846139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212846139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212846139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212846139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212846160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212846177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212846177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212846177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:28:50.068150 run osmo-msc_10.42.42.6(pid=17789): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17789)] 21:28:50.117836 run osmo-msc_10.42.42.6(pid=17789): stdout: | (launched: 2022-12-09_21:28:48.417857) 21:28:50.169221 run osmo-msc_10.42.42.6(pid=17789): stderr: | 20221209212848968 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212848968 DLGLOBAL DEBUG validating counter group 0x7fa519ad5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212848968 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212848968 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212848977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212848977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212848989 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212848989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212848989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212848990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:28:50.221126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17782): Terminating (SIGTERM) 21:28:50.264040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17785): Terminating (SIGTERM) 21:28:50.308259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17788): Terminating (SIGTERM) 21:28:50.353197 --- ParallelTerminationStrategy: PID 17782 died... 21:28:50.373238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17782): Terminated: ok {rc=0} 21:28:50.422039 --- ParallelTerminationStrategy: PID 17785 died... 21:28:50.441945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17785): Terminated: ok {rc=0} 21:28:50.489202 --- ParallelTerminationStrategy: PID 17788 died... 21:28:50.509169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17788): Terminated: ok {rc=0} 21:28:50.597051 bus /sierra_3: Setting Powered False 21:28:51.712938 bus /sierra_3: Setting Powered False 21:28:52.872310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 21:28:54.188413 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:28:54.194356 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:28:54.259090 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:28:54.286738 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:28:54.340669 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:28:54.421747 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:28:54.449526 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:28:55.004848 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 21:28:55.011072 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:55.023051 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:55.074996 tst handover.py: using LAC 23861 21:28:55.211859 tst handover.py: using RAC 146 21:28:55.403091 tst handover.py: using CellId 23861 21:28:55.544761 tst handover.py: using BVCI 23862 21:28:55.660145 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:28:55.710650 tst handover.py: using LAC 23862 21:28:55.846843 tst handover.py: using RAC 147 21:28:56.003971 tst handover.py: using CellId 23862 21:28:56.194155 tst handover.py: using BVCI 23863 21:28:56.353140 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:56.365140 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:56.376927 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:56.390084 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:56.402833 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:28:56.416570 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:56.556836 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:28:56.694325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:28:57.162528 run create_hlr_db(pid=17795): Launched 21:28:57.324890 bus /sierra_2: Setting Powered False 21:28:58.406140 run create_hlr_db(pid=17795): Terminated: ok {rc=0} 21:28:58.827203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17797): Launched 21:28:59.164149 run osmo-hlr_10.42.42.2(pid=17798): Launched 21:28:59.312853 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:00.006313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17800): Launched 21:29:00.337084 run osmo-stp_10.42.42.5(pid=17801): Launched 21:29:00.575710 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:01.312290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17803): Launched 21:29:01.739283 run osmo-msc_10.42.42.6(pid=17804): Launched 21:29:02.017617 run osmo-stp_10.42.42.5(pid=17801): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17801)] 21:29:02.312785 run osmo-stp_10.42.42.5(pid=17801): stdout: | (launched: 2022-12-09_21:29:00.277916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:02.566454 run osmo-stp_10.42.42.5(pid=17801): stderr: | 20221209212900599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212900599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212900599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212900599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212900600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212900600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212900600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:02.727059 run osmo-stp_10.42.42.5(pid=17801): stdout: | (launched: 2022-12-09_21:29:00.277916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:02.881937 run osmo-stp_10.42.42.5(pid=17801): stderr: | 20221209212900599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212900599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212900599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212900599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212900600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212900600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212900600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:03.070960 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17801): Process ended prematurely: osmo-stp_10.42.42.5(pid=17801) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17801)] [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 21:29:03.083752 tst handover.py:18: Test FAILED (8.1 sec) 21:29:03.120277 run osmo-hlr_10.42.42.2(pid=17798): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17798)] 21:29:03.178286 run osmo-hlr_10.42.42.2(pid=17798): stdout: | (launched: 2022-12-09_21:28:59.104875) 21:29:03.235761 run osmo-hlr_10.42.42.2(pid=17798): stderr: | 20221209212859440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212859440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212859440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212859440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212859441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212859441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212859462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212859478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212859479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212859479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:03.321539 run osmo-msc_10.42.42.6(pid=17804): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17804)] 21:29:03.379850 run osmo-msc_10.42.42.6(pid=17804): stdout: | (launched: 2022-12-09_21:29:01.660481) 21:29:03.434154 run osmo-msc_10.42.42.6(pid=17804): stderr: | 20221209212902245 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212902245 DLGLOBAL DEBUG validating counter group 0x7f830783cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212902245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212902245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212902245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212902246 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212902247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212902248 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212902248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212902248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:03.488037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17797): Terminating (SIGTERM) 21:29:03.531780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17800): Terminating (SIGTERM) 21:29:03.576140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17803): Terminating (SIGTERM) 21:29:03.621436 --- ParallelTerminationStrategy: PID 17797 died... 21:29:03.641412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17797): Terminated: ok {rc=0} 21:29:03.691976 --- ParallelTerminationStrategy: PID 17800 died... 21:29:03.711827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17800): Terminated: ok {rc=0} 21:29:03.759612 --- ParallelTerminationStrategy: PID 17803 died... 21:29:03.779432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17803): Terminated: ok {rc=0} 21:29:03.879721 bus /sierra_3: Setting Powered False 21:29:05.011607 bus /sierra_3: Setting Powered False 21:29:06.154023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 21:29:07.451846 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:29:07.458174 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 21:29:07.517174 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 21:29:07.545568 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 21:29:07.598559 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 21:29:07.652473 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 21:29:07.681256 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 21:29:08.245899 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 21:29:08.252619 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:08.273021 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:29:08.309085 tst handover.py: using LAC 23863 21:29:08.440341 tst handover.py: using RAC 148 21:29:08.575941 tst handover.py: using CellId 23863 21:29:08.709239 tst handover.py: using BVCI 23864 21:29:08.891018 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 21:29:08.940922 tst handover.py: using LAC 23864 21:29:09.073342 tst handover.py: using RAC 149 21:29:09.241393 tst handover.py: using CellId 23864 21:29:09.375686 tst handover.py: using BVCI 23865 21:29:09.502253 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:09.514329 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:09.527017 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:09.539019 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:09.550635 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 21:29:09.562891 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:29:09.684657 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 21:29:09.809665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:10.301448 run create_hlr_db(pid=17809): Launched 21:29:10.498024 bus /sierra_2: Setting Powered False 21:29:11.563975 run create_hlr_db(pid=17809): Terminated: ok {rc=0} 21:29:12.008360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Launched 21:29:12.358306 run osmo-hlr_10.42.42.2(pid=17812): Launched 21:29:12.608588 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:13.250774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Launched 21:29:13.597118 run osmo-stp_10.42.42.5(pid=17815): Launched 21:29:13.851245 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:14.594846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Launched 21:29:15.094517 run osmo-msc_10.42.42.6(pid=17818): Launched 21:29:15.466353 run osmo-stp_10.42.42.5(pid=17815): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] 21:29:15.750935 run osmo-stp_10.42.42.5(pid=17815): stdout: | (launched: 2022-12-09_21:29:13.534886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:15.969915 run osmo-stp_10.42.42.5(pid=17815): stderr: | 20221209212913829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212913829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212913830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212913830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212913831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212913831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212913831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:16.114532 run osmo-stp_10.42.42.5(pid=17815): stdout: | (launched: 2022-12-09_21:29:13.534886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:16.248178 run osmo-stp_10.42.42.5(pid=17815): stderr: | 20221209212913829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212913829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212913830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212913830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212913831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212913831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212913831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:16.412923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17815): Process ended prematurely: osmo-stp_10.42.42.5(pid=17815) [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 21:29:16.422687 tst handover.py:18: Test FAILED (8.2 sec) 21:29:16.451508 run osmo-hlr_10.42.42.2(pid=17812): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17812)] 21:29:16.503467 run osmo-hlr_10.42.42.2(pid=17812): stdout: | (launched: 2022-12-09_21:29:12.296431) 21:29:16.557402 run osmo-hlr_10.42.42.2(pid=17812): stderr: | 20221209212912597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212912598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212912598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212912598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212912598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212912598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212912615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212912631 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212912631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212912631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:16.632827 run osmo-msc_10.42.42.6(pid=17818): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17818)] 21:29:16.684381 run osmo-msc_10.42.42.6(pid=17818): stdout: | (launched: 2022-12-09_21:29:14.999903) 21:29:16.737952 run osmo-msc_10.42.42.6(pid=17818): stderr: | 20221209212915558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212915558 DLGLOBAL DEBUG validating counter group 0x7f30ade76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212915558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212915558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212915558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212915558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212915560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212915561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212915561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212915561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:16.791618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Terminating (SIGTERM) 21:29:16.834979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Terminating (SIGTERM) 21:29:16.880857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Terminating (SIGTERM) 21:29:16.926976 --- ParallelTerminationStrategy: PID 17811 died... 21:29:16.947727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17811): Terminated: ok {rc=0} 21:29:16.996741 --- ParallelTerminationStrategy: PID 17814 died... 21:29:17.017595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17814): Terminated: ok {rc=0} 21:29:17.065669 --- ParallelTerminationStrategy: PID 17817 died... 21:29:17.086008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17817): Terminated: ok {rc=0} 21:29:17.176807 bus /sierra_3: Setting Powered False 21:29:18.296019 bus /sierra_3: Setting Powered False 21:29:19.411016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 21:29:20.672338 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:29:20.678736 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:29:20.732852 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:29:20.760269 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:29:20.818593 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:29:20.889164 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:29:20.934359 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:29:21.439927 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 21:29:21.446736 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:21.459908 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:21.497270 tst handover.py: using LAC 23865 21:29:21.622165 tst handover.py: using RAC 150 21:29:21.751644 tst handover.py: using CellId 23865 21:29:21.884819 tst handover.py: using BVCI 23866 21:29:22.011604 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:22.060711 tst handover.py: using LAC 23866 21:29:22.190390 tst handover.py: using RAC 151 21:29:22.319728 tst handover.py: using CellId 23866 21:29:22.450353 tst handover.py: using BVCI 23867 21:29:22.575382 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:22.587586 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:22.599232 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:22.611173 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:22.622951 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:22.635003 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:22.759045 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:22.885811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:23.386723 run create_hlr_db(pid=17823): Launched 21:29:23.536160 bus /sierra_2: Setting Powered False 21:29:24.607079 run create_hlr_db(pid=17823): Terminated: ok {rc=0} 21:29:25.027700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Launched 21:29:25.350021 run osmo-hlr_10.42.42.2(pid=17826): Launched 21:29:25.483391 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:26.022343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Launched 21:29:26.353711 run osmo-stp_10.42.42.5(pid=17829): Launched 21:29:26.485157 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:27.042143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17831): Launched 21:29:27.364184 run osmo-msc_10.42.42.6(pid=17832): Launched 21:29:27.558757 run osmo-stp_10.42.42.5(pid=17829): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] 21:29:27.705552 run osmo-stp_10.42.42.5(pid=17829): stdout: | (launched: 2022-12-09_21:29:26.292835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:27.841380 run osmo-stp_10.42.42.5(pid=17829): stderr: | 20221209212926467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212926467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212926467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212926467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212926468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212926468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212926468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:27.973837 run osmo-stp_10.42.42.5(pid=17829): stdout: | (launched: 2022-12-09_21:29:26.292835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:28.101476 run osmo-stp_10.42.42.5(pid=17829): stderr: | 20221209212926467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212926467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212926467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212926467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212926468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212926468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212926468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:28.254725 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17829): Process ended prematurely: osmo-stp_10.42.42.5(pid=17829) [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 21:29:28.263753 tst handover.py:18: Test FAILED (6.8 sec) 21:29:28.291417 run osmo-hlr_10.42.42.2(pid=17826): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17826)] 21:29:28.341172 run osmo-hlr_10.42.42.2(pid=17826): stdout: | (launched: 2022-12-09_21:29:25.290332) 21:29:28.392266 run osmo-hlr_10.42.42.2(pid=17826): stderr: | 20221209212925468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212925468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212925468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212925468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212925468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212925469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212925481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212925490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212925490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212925490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:28.464434 run osmo-msc_10.42.42.6(pid=17832): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17832)] 21:29:28.513963 run osmo-msc_10.42.42.6(pid=17832): stdout: | (launched: 2022-12-09_21:29:27.304059) 21:29:28.565536 run osmo-msc_10.42.42.6(pid=17832): stderr: | 20221209212927579 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212927579 DLGLOBAL DEBUG validating counter group 0x7fc9d7478c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212927579 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212927579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212927579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212927579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212927581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212927582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212927582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212927582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:28.617849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Terminating (SIGTERM) 21:29:28.658766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Terminating (SIGTERM) 21:29:28.699796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17831): Terminating (SIGTERM) 21:29:28.741619 --- ParallelTerminationStrategy: PID 17825 died... 21:29:28.761431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17825): Terminated: ok {rc=0} 21:29:28.807603 --- ParallelTerminationStrategy: PID 17828 died... 21:29:28.826870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17828): Terminated: ok {rc=0} 21:29:28.872365 --- ParallelTerminationStrategy: PID 17831 died... 21:29:28.892403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17831): Terminated: ok {rc=0} 21:29:28.980377 bus /sierra_3: Setting Powered False 21:29:30.078491 bus /sierra_3: Setting Powered False 21:29:31.196197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2364 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 21:29:32.464476 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 21:29:32.470580 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 21:29:32.535391 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 21:29:32.563499 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 21:29:32.617943 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 21:29:32.683429 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 21:29:32.711214 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 21:29:33.256583 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2364 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 21:29:33.262413 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:33.273454 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:33.322165 tst handover.py: using LAC 23867 21:29:33.449867 tst handover.py: using RAC 152 21:29:33.578755 tst handover.py: using CellId 23867 21:29:33.709309 tst handover.py: using BVCI 23868 21:29:33.825488 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 21:29:33.874391 tst handover.py: using LAC 23868 21:29:34.001026 tst handover.py: using RAC 153 21:29:34.127872 tst handover.py: using CellId 23868 21:29:34.261375 tst handover.py: using BVCI 23869 21:29:34.380308 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:34.391848 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:34.403476 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:34.415060 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:34.426914 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 21:29:34.438136 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:34.560285 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 21:29:34.683260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 21:29:35.163862 run create_hlr_db(pid=17837): Launched 21:29:35.290236 bus /sierra_2: Setting Powered False 21:29:36.353755 run create_hlr_db(pid=17837): Terminated: ok {rc=0} 21:29:36.787010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17839): Launched 21:29:37.123242 run osmo-hlr_10.42.42.2(pid=17840): Launched 21:29:37.252261 run osmo-stp_10.42.42.5: Starting osmo-stp 21:29:37.808303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17842): Launched 21:29:38.140424 run osmo-stp_10.42.42.5(pid=17843): Launched 21:29:38.409127 run osmo-msc_10.42.42.6: Starting osmo-msc 21:29:39.069725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17845): Launched 21:29:39.434241 run osmo-msc_10.42.42.6(pid=17846): Launched 21:29:39.820649 run osmo-stp_10.42.42.5(pid=17843): ERR: Terminated: ERROR {rc=1} [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17843)] 21:29:40.157194 run osmo-stp_10.42.42.5(pid=17843): stdout: | (launched: 2022-12-09_21:29:38.081321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:40.406470 run osmo-stp_10.42.42.5(pid=17843): stderr: | 20221209212938379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212938379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212938379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212938379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212938380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212938380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212938380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:40.549287 run osmo-stp_10.42.42.5(pid=17843): stdout: | (launched: 2022-12-09_21:29:38.081321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 21:29:40.686703 run osmo-stp_10.42.42.5(pid=17843): stderr: | 20221209212938379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209212938379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209212938379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209212938379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209212938380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209212938380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209212938380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 21:29:40.849245 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17843): Process ended prematurely: osmo-stp_10.42.42.5(pid=17843) [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17843)] [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 21:29:40.858631 tst handover.py:18: Test FAILED (7.6 sec) 21:29:40.888619 run osmo-hlr_10.42.42.2(pid=17840): ERR: Terminated: ERROR {rc=237} [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17840)] 21:29:40.941867 run osmo-hlr_10.42.42.2(pid=17840): stdout: | (launched: 2022-12-09_21:29:37.060774) 21:29:40.996102 run osmo-hlr_10.42.42.2(pid=17840): stderr: | 20221209212937266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209212937266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209212937266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209212937266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209212937266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209212937266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209212937281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209212937290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209212937290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209212937290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 21:29:41.071867 run osmo-msc_10.42.42.6(pid=17846): ERR: Terminated: ERROR {rc=2} [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17846)] 21:29:41.124863 run osmo-msc_10.42.42.6(pid=17846): stdout: | (launched: 2022-12-09_21:29:39.363143) 21:29:41.179004 run osmo-msc_10.42.42.6(pid=17846): stderr: | 20221209212939928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209212939928 DLGLOBAL DEBUG validating counter group 0x7fdc5c02fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209212939928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209212939928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209212939928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209212939928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209212939938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209212939939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209212939939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209212939939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 21:29:41.233633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17839): Terminating (SIGTERM) 21:29:41.277415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17842): Terminating (SIGTERM) 21:29:41.323568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17845): Terminating (SIGTERM) 21:29:41.369726 --- ParallelTerminationStrategy: PID 17839 died... 21:29:41.390429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17839): Terminated: ok {rc=0} 21:29:41.440795 --- ParallelTerminationStrategy: PID 17842 died... 21:29:41.461277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17842): Terminated: ok {rc=0} 21:29:41.510867 --- ParallelTerminationStrategy: PID 17845 died... 21:29:41.531070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17845): Terminated: ok {rc=0} 21:29:41.621193 bus /sierra_3: Setting Powered False 21:29:42.738896 bus /sierra_3: Setting Powered False 21:29:43.860218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2364 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 21:29:45.143008 tst trial-2364: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364/run.2022-12-09_20-04-44/trial-2364.xml -------------------------------------------------------------------------------------------- trial-2364 FAIL -------------------------------------------------------------------------------------------- 21:29:47.561641 tst trial-2364: trial-2364: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=9748): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9748) [trial-2364↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9748)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2364↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9770): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9770) [trial-2364↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9770)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9780): Process ended prematurely: osmo-stp_10.42.42.5(pid=9780) [trial-2364↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9780)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9796): Process ended prematurely: osmo-stp_10.42.42.5(pid=9796) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9796)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9807): Process ended prematurely: osmo-stp_10.42.42.5(pid=9807) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9807)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=9821): Process ended prematurely: osmo-stp_10.42.42.5(pid=9821) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9821)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10103): Process ended prematurely: osmo-stp_10.42.42.5(pid=10103) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10103)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10118): Process ended prematurely: osmo-stp_10.42.42.5(pid=10118) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10118)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10129): Process ended prematurely: osmo-stp_10.42.42.5(pid=10129) [trial-2364↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10129)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10144): Process ended prematurely: osmo-stp_10.42.42.5(pid=10144) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10144)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10155): Process ended prematurely: osmo-stp_10.42.42.5(pid=10155) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10155)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10170): Process ended prematurely: osmo-stp_10.42.42.5(pid=10170) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10170)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10181): Process ended prematurely: osmo-stp_10.42.42.5(pid=10181) [trial-2364↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10181)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10195): Process ended prematurely: osmo-stp_10.42.42.5(pid=10195) [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10195)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10207): Process ended prematurely: osmo-stp_10.42.42.5(pid=10207) [trial-2364↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10207)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10223): Process ended prematurely: osmo-stp_10.42.42.5(pid=10223) [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10223)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10237): Process ended prematurely: osmo-stp_10.42.42.5(pid=10237) [trial-2364↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10237)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10251): Process ended prematurely: osmo-stp_10.42.42.5(pid=10251) [trial-2364↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10251)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10262): Process ended prematurely: osmo-stp_10.42.42.5(pid=10262) [trial-2364↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=10280): Process ended prematurely: osmo-stp_10.42.42.5(pid=10280) [trial-2364↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10280)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10292): Process ended prematurely: osmo-stp_10.42.42.5(pid=10292) [trial-2364↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10292)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10310): Process ended prematurely: osmo-stp_10.42.42.5(pid=10310) [trial-2364↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10310)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10320): Process ended prematurely: osmo-stp_10.42.42.5(pid=10320) [trial-2364↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10320)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10330): Process ended prematurely: osmo-stp_10.42.42.5(pid=10330) [trial-2364↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10330)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10347): Process ended prematurely: osmo-stp_10.42.42.5(pid=10347) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10347)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10359): Process ended prematurely: osmo-stp_10.42.42.5(pid=10359) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10359)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10377): Process ended prematurely: osmo-stp_10.42.42.5(pid=10377) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10377)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10387): Process ended prematurely: osmo-stp_10.42.42.5(pid=10387) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10387)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10397): Process ended prematurely: osmo-stp_10.42.42.5(pid=10397) [trial-2364↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10397)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10417): Process ended prematurely: osmo-stp_10.42.42.5(pid=10417) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10417)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10429): Process ended prematurely: osmo-stp_10.42.42.5(pid=10429) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10429)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10447): Process ended prematurely: osmo-stp_10.42.42.5(pid=10447) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10447)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10457): Process ended prematurely: osmo-stp_10.42.42.5(pid=10457) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10457)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10467): Process ended prematurely: osmo-stp_10.42.42.5(pid=10467) [trial-2364↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10467)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=10485): Process ended prematurely: osmo-stp_10.42.42.5(pid=10485) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10485)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10497): Process ended prematurely: osmo-stp_10.42.42.5(pid=10497) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10497)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10515): Process ended prematurely: osmo-stp_10.42.42.5(pid=10515) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10515)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10525): Process ended prematurely: osmo-stp_10.42.42.5(pid=10525) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10525)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10535): Process ended prematurely: osmo-stp_10.42.42.5(pid=10535) [trial-2364↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10535)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2364↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10563): Process ended prematurely: osmo-stp_10.42.42.5(pid=10563) [trial-2364↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10563)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=10574): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10574) [trial-2364↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10574)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10584): Process ended prematurely: osmo-stp_10.42.42.5(pid=10584) [trial-2364↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10584)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10593): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10593) [trial-2364↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10593)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=10603): Process ended prematurely: osmo-stp_10.42.42.5(pid=10603) [trial-2364↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10603)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10617): Process ended prematurely: osmo-stp_10.42.42.5(pid=10617) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10617)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10628): Process ended prematurely: osmo-stp_10.42.42.5(pid=10628) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10643): Process ended prematurely: osmo-stp_10.42.42.5(pid=10643) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10643)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10654): Process ended prematurely: osmo-stp_10.42.42.5(pid=10654) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10668): Process ended prematurely: osmo-stp_10.42.42.5(pid=10668) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10679): Process ended prematurely: osmo-stp_10.42.42.5(pid=10679) [trial-2364↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10693): Process ended prematurely: osmo-stp_10.42.42.5(pid=10693) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10693)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10704): Process ended prematurely: osmo-stp_10.42.42.5(pid=10704) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10704)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10746): Process ended prematurely: osmo-stp_10.42.42.5(pid=10746) [trial-2364↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10746)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10760): Process ended prematurely: osmo-stp_10.42.42.5(pid=10760) [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10760)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10771): Process ended prematurely: osmo-stp_10.42.42.5(pid=10771) [trial-2364↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10771)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10787): Process ended prematurely: osmo-stp_10.42.42.5(pid=10787) [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10787)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10798): Process ended prematurely: osmo-stp_10.42.42.5(pid=10798) [trial-2364↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10798)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10812): Process ended prematurely: osmo-stp_10.42.42.5(pid=10812) [trial-2364↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10812)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10823): Process ended prematurely: osmo-stp_10.42.42.5(pid=10823) [trial-2364↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10823)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10841): Process ended prematurely: osmo-stp_10.42.42.5(pid=10841) [trial-2364↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10841)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=10853): Process ended prematurely: osmo-stp_10.42.42.5(pid=10853) [trial-2364↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10853)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10871): Process ended prematurely: osmo-stp_10.42.42.5(pid=10871) [trial-2364↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10871)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2364↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10892): Process ended prematurely: osmo-stp_10.42.42.5(pid=10892) [trial-2364↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10892)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10922): Process ended prematurely: osmo-stp_10.42.42.5(pid=10922) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10922)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10934): Process ended prematurely: osmo-stp_10.42.42.5(pid=10934) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10934)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=10952): Process ended prematurely: osmo-stp_10.42.42.5(pid=10952) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10952)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10976): Process ended prematurely: osmo-stp_10.42.42.5(pid=10976) [trial-2364↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10976)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10995): Process ended prematurely: osmo-stp_10.42.42.5(pid=10995) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10995)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11008): Process ended prematurely: osmo-stp_10.42.42.5(pid=11008) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11046): Process ended prematurely: osmo-stp_10.42.42.5(pid=11046) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11046)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11057): Process ended prematurely: osmo-stp_10.42.42.5(pid=11057) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11057)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2364↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=11085): Process ended prematurely: osmo-stp_10.42.42.5(pid=11085) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11085)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=11115): Process ended prematurely: osmo-stp_10.42.42.5(pid=11115) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11115)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11125): Process ended prematurely: osmo-stp_10.42.42.5(pid=11125) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11125)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11135): Process ended prematurely: osmo-stp_10.42.42.5(pid=11135) [trial-2364↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11135)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11154): Process ended prematurely: osmo-stp_10.42.42.5(pid=11154) [trial-2364↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11154)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11167): Process ended prematurely: osmo-stp_10.42.42.5(pid=11167) [trial-2364↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11167)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11175): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11175) [trial-2364↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11175)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11199): Process ended prematurely: osmo-stp_10.42.42.5(pid=11199) [trial-2364↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11199)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=11465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11465) [trial-2364↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11465)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11475): Process ended prematurely: osmo-stp_10.42.42.5(pid=11475) [trial-2364↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11475)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11490): Process ended prematurely: osmo-stp_10.42.42.5(pid=11490) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11490)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11501): Process ended prematurely: osmo-stp_10.42.42.5(pid=11501) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11501)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11515): Process ended prematurely: osmo-stp_10.42.42.5(pid=11515) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11515)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11526): Process ended prematurely: osmo-stp_10.42.42.5(pid=11526) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11526)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11540): Process ended prematurely: osmo-stp_10.42.42.5(pid=11540) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11540)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11551): Process ended prematurely: osmo-stp_10.42.42.5(pid=11551) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11551)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11565): Process ended prematurely: osmo-stp_10.42.42.5(pid=11565) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11565)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11576): Process ended prematurely: osmo-stp_10.42.42.5(pid=11576) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11576)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11590): Process ended prematurely: osmo-stp_10.42.42.5(pid=11590) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11590)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11604): Process ended prematurely: osmo-stp_10.42.42.5(pid=11604) [trial-2364↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11604)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11618): Process ended prematurely: osmo-stp_10.42.42.5(pid=11618) [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11618)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11629): Process ended prematurely: osmo-stp_10.42.42.5(pid=11629) [trial-2364↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11629)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11644): Process ended prematurely: osmo-stp_10.42.42.5(pid=11644) [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11644)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11655): Process ended prematurely: osmo-stp_10.42.42.5(pid=11655) [trial-2364↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11655)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11670): Process ended prematurely: osmo-stp_10.42.42.5(pid=11670) [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11670)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11681): Process ended prematurely: osmo-stp_10.42.42.5(pid=11681) [trial-2364↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11681)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11695): Process ended prematurely: osmo-stp_10.42.42.5(pid=11695) [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11695)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11706): Process ended prematurely: osmo-stp_10.42.42.5(pid=11706) [trial-2364↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11706)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11721): Process ended prematurely: osmo-stp_10.42.42.5(pid=11721) [trial-2364↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11721)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11732): Process ended prematurely: osmo-stp_10.42.42.5(pid=11732) [trial-2364↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11732)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11751): Process ended prematurely: osmo-stp_10.42.42.5(pid=11751) [trial-2364↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11763): Process ended prematurely: osmo-stp_10.42.42.5(pid=11763) [trial-2364↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11763)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=11784): Process ended prematurely: osmo-stp_10.42.42.5(pid=11784) [trial-2364↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11784)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11794): Process ended prematurely: osmo-stp_10.42.42.5(pid=11794) [trial-2364↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11794)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11804): Process ended prematurely: osmo-stp_10.42.42.5(pid=11804) [trial-2364↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11804)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11821): Process ended prematurely: osmo-stp_10.42.42.5(pid=11821) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11821)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11862): Process ended prematurely: osmo-stp_10.42.42.5(pid=11862) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11862)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11872): Process ended prematurely: osmo-stp_10.42.42.5(pid=11872) [trial-2364↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11872)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11889): Process ended prematurely: osmo-stp_10.42.42.5(pid=11889) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11901): Process ended prematurely: osmo-stp_10.42.42.5(pid=11901) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11901)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=11919): Process ended prematurely: osmo-stp_10.42.42.5(pid=11919) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11919)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11929): Process ended prematurely: osmo-stp_10.42.42.5(pid=11929) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11929)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11942): Process ended prematurely: osmo-stp_10.42.42.5(pid=11942) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11942)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11959): Process ended prematurely: osmo-stp_10.42.42.5(pid=11959) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11959)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11971): Process ended prematurely: osmo-stp_10.42.42.5(pid=11971) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11971)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12000): Process ended prematurely: osmo-stp_10.42.42.5(pid=12000) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12010): Process ended prematurely: osmo-stp_10.42.42.5(pid=12010) [trial-2364↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12010)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12027): Process ended prematurely: osmo-stp_10.42.42.5(pid=12027) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12027)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12039): Process ended prematurely: osmo-stp_10.42.42.5(pid=12039) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12039)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12057): Process ended prematurely: osmo-stp_10.42.42.5(pid=12057) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12057)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12067): Process ended prematurely: osmo-stp_10.42.42.5(pid=12067) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12067)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12077): Process ended prematurely: osmo-stp_10.42.42.5(pid=12077) [trial-2364↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12077)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12093): Process ended prematurely: osmo-stp_10.42.42.5(pid=12093) [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12093)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12109): Process ended prematurely: osmo-stp_10.42.42.5(pid=12109) [trial-2364↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12109)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12117): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12117) [trial-2364↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12117)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12127): Process ended prematurely: osmo-stp_10.42.42.5(pid=12127) [trial-2364↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12127)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12136): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12136) [trial-2364↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12136)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12146): Process ended prematurely: osmo-stp_10.42.42.5(pid=12146) [trial-2364↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12146)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12161): Process ended prematurely: osmo-stp_10.42.42.5(pid=12161) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12161)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12172): Process ended prematurely: osmo-stp_10.42.42.5(pid=12172) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12186): Process ended prematurely: osmo-stp_10.42.42.5(pid=12186) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12186)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12197): Process ended prematurely: osmo-stp_10.42.42.5(pid=12197) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12197)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12212): Process ended prematurely: osmo-stp_10.42.42.5(pid=12212) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12212)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12227): Process ended prematurely: osmo-stp_10.42.42.5(pid=12227) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12227)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12241): Process ended prematurely: osmo-stp_10.42.42.5(pid=12241) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12241)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12252): Process ended prematurely: osmo-stp_10.42.42.5(pid=12252) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12252)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12266): Process ended prematurely: osmo-stp_10.42.42.5(pid=12266) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12266)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12277): Process ended prematurely: osmo-stp_10.42.42.5(pid=12277) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12277)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12291): Process ended prematurely: osmo-stp_10.42.42.5(pid=12291) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12305): Process ended prematurely: osmo-stp_10.42.42.5(pid=12305) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12305)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12319): Process ended prematurely: osmo-stp_10.42.42.5(pid=12319) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12319)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12330): Process ended prematurely: osmo-stp_10.42.42.5(pid=12330) [trial-2364↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12330)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12344): Process ended prematurely: osmo-stp_10.42.42.5(pid=12344) [trial-2364↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12344)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12355): Process ended prematurely: osmo-stp_10.42.42.5(pid=12355) [trial-2364↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12355)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12373): Process ended prematurely: osmo-stp_10.42.42.5(pid=12373) [trial-2364↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12373)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12385): Process ended prematurely: osmo-stp_10.42.42.5(pid=12385) [trial-2364↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12385)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=12403): Process ended prematurely: osmo-stp_10.42.42.5(pid=12403) [trial-2364↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12403)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12414): Process ended prematurely: osmo-stp_10.42.42.5(pid=12414) [trial-2364↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12414)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2364↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12453): Process ended prematurely: osmo-stp_10.42.42.5(pid=12453) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12453)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12471): Process ended prematurely: osmo-stp_10.42.42.5(pid=12471) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12471)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12483): Process ended prematurely: osmo-stp_10.42.42.5(pid=12483) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12483)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12493): Process ended prematurely: osmo-stp_10.42.42.5(pid=12493) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12493)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=12781): Process ended prematurely: osmo-stp_10.42.42.5(pid=12781) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=12793): Process ended prematurely: osmo-stp_10.42.42.5(pid=12793) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12793)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12811): Process ended prematurely: osmo-stp_10.42.42.5(pid=12811) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12811)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12821): Process ended prematurely: osmo-stp_10.42.42.5(pid=12821) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12821)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12832): Process ended prematurely: osmo-stp_10.42.42.5(pid=12832) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12832)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12850): Process ended prematurely: osmo-stp_10.42.42.5(pid=12850) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12850)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12863): Process ended prematurely: osmo-stp_10.42.42.5(pid=12863) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12863)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12881): Process ended prematurely: osmo-stp_10.42.42.5(pid=12881) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12881)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12891): Process ended prematurely: osmo-stp_10.42.42.5(pid=12891) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12891)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12901): Process ended prematurely: osmo-stp_10.42.42.5(pid=12901) [trial-2364↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12901)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12917): Process ended prematurely: osmo-stp_10.42.42.5(pid=12917) [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12917)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12930): Process ended prematurely: osmo-stp_10.42.42.5(pid=12930) [trial-2364↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12930)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=12938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12938) [trial-2364↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12938)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=12950): Process ended prematurely: osmo-stp_10.42.42.5(pid=12950) [trial-2364↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12950)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12959): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12959) [trial-2364↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12959)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12969): Process ended prematurely: osmo-stp_10.42.42.5(pid=12969) [trial-2364↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12969)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12983): Process ended prematurely: osmo-stp_10.42.42.5(pid=12983) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12983)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12994): Process ended prematurely: osmo-stp_10.42.42.5(pid=12994) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12994)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13008): Process ended prematurely: osmo-stp_10.42.42.5(pid=13008) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13008)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13019): Process ended prematurely: osmo-stp_10.42.42.5(pid=13019) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13019)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13033): Process ended prematurely: osmo-stp_10.42.42.5(pid=13033) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13033)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13044): Process ended prematurely: osmo-stp_10.42.42.5(pid=13044) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13044)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13060): Process ended prematurely: osmo-stp_10.42.42.5(pid=13060) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13060)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13071): Process ended prematurely: osmo-stp_10.42.42.5(pid=13071) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13085): Process ended prematurely: osmo-stp_10.42.42.5(pid=13085) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13085)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13096): Process ended prematurely: osmo-stp_10.42.42.5(pid=13096) [trial-2364↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13096)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13110): Process ended prematurely: osmo-stp_10.42.42.5(pid=13110) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13110)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13121): Process ended prematurely: osmo-stp_10.42.42.5(pid=13121) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13121)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13135): Process ended prematurely: osmo-stp_10.42.42.5(pid=13135) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13135)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13146): Process ended prematurely: osmo-stp_10.42.42.5(pid=13146) [trial-2364↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13146)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13161): Process ended prematurely: osmo-stp_10.42.42.5(pid=13161) [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13161)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13172): Process ended prematurely: osmo-stp_10.42.42.5(pid=13172) [trial-2364↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13186): Process ended prematurely: osmo-stp_10.42.42.5(pid=13186) [trial-2364↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13186)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13197): Process ended prematurely: osmo-stp_10.42.42.5(pid=13197) [trial-2364↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13216): Process ended prematurely: osmo-stp_10.42.42.5(pid=13216) [trial-2364↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13216)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13228): Process ended prematurely: osmo-stp_10.42.42.5(pid=13228) [trial-2364↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13228)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13246): Process ended prematurely: osmo-stp_10.42.42.5(pid=13246) [trial-2364↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13246)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13261): Process ended prematurely: osmo-stp_10.42.42.5(pid=13261) [trial-2364↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13261)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13271): Process ended prematurely: osmo-stp_10.42.42.5(pid=13271) [trial-2364↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13288): Process ended prematurely: osmo-stp_10.42.42.5(pid=13288) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13288)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13300): Process ended prematurely: osmo-stp_10.42.42.5(pid=13300) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13300)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13318): Process ended prematurely: osmo-stp_10.42.42.5(pid=13318) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13318)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13328): Process ended prematurely: osmo-stp_10.42.42.5(pid=13328) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13328)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13338): Process ended prematurely: osmo-stp_10.42.42.5(pid=13338) [trial-2364↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13338)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13356): Process ended prematurely: osmo-stp_10.42.42.5(pid=13356) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13356)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13368): Process ended prematurely: osmo-stp_10.42.42.5(pid=13368) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13368)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=13386): Process ended prematurely: osmo-stp_10.42.42.5(pid=13386) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13386)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13396): Process ended prematurely: osmo-stp_10.42.42.5(pid=13396) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13396)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13406): Process ended prematurely: osmo-stp_10.42.42.5(pid=13406) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13406)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=13423): Process ended prematurely: osmo-stp_10.42.42.5(pid=13423) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13423)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13435): Process ended prematurely: osmo-stp_10.42.42.5(pid=13435) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13435)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=13456): Process ended prematurely: osmo-stp_10.42.42.5(pid=13456) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13456)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13466): Process ended prematurely: osmo-stp_10.42.42.5(pid=13466) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13466)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13476): Process ended prematurely: osmo-stp_10.42.42.5(pid=13476) [trial-2364↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13476)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13493): Process ended prematurely: osmo-stp_10.42.42.5(pid=13493) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13493)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13505): Process ended prematurely: osmo-stp_10.42.42.5(pid=13505) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13505)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=13523): Process ended prematurely: osmo-stp_10.42.42.5(pid=13523) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13523)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13533): Process ended prematurely: osmo-stp_10.42.42.5(pid=13533) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13533)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13543): Process ended prematurely: osmo-stp_10.42.42.5(pid=13543) [trial-2364↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13559): Process ended prematurely: osmo-stp_10.42.42.5(pid=13559) [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13559)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=13572): Process ended prematurely: osmo-stp_10.42.42.5(pid=13572) [trial-2364↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13572)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13580): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13580) [trial-2364↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13580)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13590): Process ended prematurely: osmo-stp_10.42.42.5(pid=13590) [trial-2364↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13590)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13599): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13599) [trial-2364↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13599)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13612): Process ended prematurely: osmo-stp_10.42.42.5(pid=13612) [trial-2364↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13612)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13626): Process ended prematurely: osmo-stp_10.42.42.5(pid=13626) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13626)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13640): Process ended prematurely: osmo-stp_10.42.42.5(pid=13640) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13640)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13654): Process ended prematurely: osmo-stp_10.42.42.5(pid=13654) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13654)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13665): Process ended prematurely: osmo-stp_10.42.42.5(pid=13665) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13679): Process ended prematurely: osmo-stp_10.42.42.5(pid=13679) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13679)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13690): Process ended prematurely: osmo-stp_10.42.42.5(pid=13690) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13690)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13704): Process ended prematurely: osmo-stp_10.42.42.5(pid=13704) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13704)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13730): Process ended prematurely: osmo-stp_10.42.42.5(pid=13730) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13730)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13741): Process ended prematurely: osmo-stp_10.42.42.5(pid=13741) [trial-2364↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13755): Process ended prematurely: osmo-stp_10.42.42.5(pid=13755) [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13766): Process ended prematurely: osmo-stp_10.42.42.5(pid=13766) [trial-2364↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13766)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13780): Process ended prematurely: osmo-stp_10.42.42.5(pid=13780) [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13780)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13791): Process ended prematurely: osmo-stp_10.42.42.5(pid=13791) [trial-2364↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13791)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13809): Process ended prematurely: osmo-stp_10.42.42.5(pid=13809) [trial-2364↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13809)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13820): Process ended prematurely: osmo-stp_10.42.42.5(pid=13820) [trial-2364↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=14110): Process ended prematurely: osmo-stp_10.42.42.5(pid=14110) [trial-2364↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14110)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14122): Process ended prematurely: osmo-stp_10.42.42.5(pid=14122) [trial-2364↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14140): Process ended prematurely: osmo-stp_10.42.42.5(pid=14140) [trial-2364↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14140)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14150): Process ended prematurely: osmo-stp_10.42.42.5(pid=14150) [trial-2364↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14150)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14160): Process ended prematurely: osmo-stp_10.42.42.5(pid=14160) [trial-2364↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14178): Process ended prematurely: osmo-stp_10.42.42.5(pid=14178) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14178)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14191): Process ended prematurely: osmo-stp_10.42.42.5(pid=14191) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14191)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14209): Process ended prematurely: osmo-stp_10.42.42.5(pid=14209) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14209)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14220): Process ended prematurely: osmo-stp_10.42.42.5(pid=14220) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14220)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14233): Process ended prematurely: osmo-stp_10.42.42.5(pid=14233) [trial-2364↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14233)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14251): Process ended prematurely: osmo-stp_10.42.42.5(pid=14251) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14251)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14263): Process ended prematurely: osmo-stp_10.42.42.5(pid=14263) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14263)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14281): Process ended prematurely: osmo-stp_10.42.42.5(pid=14281) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14281)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14291): Process ended prematurely: osmo-stp_10.42.42.5(pid=14291) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14291)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14301): Process ended prematurely: osmo-stp_10.42.42.5(pid=14301) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14301)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=14318): Process ended prematurely: osmo-stp_10.42.42.5(pid=14318) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14318)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14330): Process ended prematurely: osmo-stp_10.42.42.5(pid=14330) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14330)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=14348): Process ended prematurely: osmo-stp_10.42.42.5(pid=14348) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14348)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14358): Process ended prematurely: osmo-stp_10.42.42.5(pid=14358) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14358)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14368): Process ended prematurely: osmo-stp_10.42.42.5(pid=14368) [trial-2364↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14368)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14381): Process ended prematurely: osmo-stp_10.42.42.5(pid=14381) [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14381)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14394): Process ended prematurely: osmo-stp_10.42.42.5(pid=14394) [trial-2364↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14394)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14404): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14404) [trial-2364↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14404)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14415): Process ended prematurely: osmo-stp_10.42.42.5(pid=14415) [trial-2364↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14415)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14424) [trial-2364↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14424)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14436): Process ended prematurely: osmo-stp_10.42.42.5(pid=14436) [trial-2364↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14450): Process ended prematurely: osmo-stp_10.42.42.5(pid=14450) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14450)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14461): Process ended prematurely: osmo-stp_10.42.42.5(pid=14461) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14461)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14475): Process ended prematurely: osmo-stp_10.42.42.5(pid=14475) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14475)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14486): Process ended prematurely: osmo-stp_10.42.42.5(pid=14486) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14500): Process ended prematurely: osmo-stp_10.42.42.5(pid=14500) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14500)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14511): Process ended prematurely: osmo-stp_10.42.42.5(pid=14511) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14511)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14537): Process ended prematurely: osmo-stp_10.42.42.5(pid=14537) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14537)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14551): Process ended prematurely: osmo-stp_10.42.42.5(pid=14551) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14551)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14562): Process ended prematurely: osmo-stp_10.42.42.5(pid=14562) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14562)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14631): Process ended prematurely: osmo-stp_10.42.42.5(pid=14631) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14631)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14647): Process ended prematurely: osmo-stp_10.42.42.5(pid=14647) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14647)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14658): Process ended prematurely: osmo-stp_10.42.42.5(pid=14658) [trial-2364↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14672): Process ended prematurely: osmo-stp_10.42.42.5(pid=14672) [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14683): Process ended prematurely: osmo-stp_10.42.42.5(pid=14683) [trial-2364↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14683)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14701): Process ended prematurely: osmo-stp_10.42.42.5(pid=14701) [trial-2364↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14701)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14713): Process ended prematurely: osmo-stp_10.42.42.5(pid=14713) [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14713)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=14731): Process ended prematurely: osmo-stp_10.42.42.5(pid=14731) [trial-2364↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=14741): Process ended prematurely: osmo-stp_10.42.42.5(pid=14741) [trial-2364↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14741)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14751): Process ended prematurely: osmo-stp_10.42.42.5(pid=14751) [trial-2364↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14751)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14769): Process ended prematurely: osmo-stp_10.42.42.5(pid=14769) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14769)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14781): Process ended prematurely: osmo-stp_10.42.42.5(pid=14781) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14781)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14799): Process ended prematurely: osmo-stp_10.42.42.5(pid=14799) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14799)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14811): Process ended prematurely: osmo-stp_10.42.42.5(pid=14811) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14811)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14821): Process ended prematurely: osmo-stp_10.42.42.5(pid=14821) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14821)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14839): Process ended prematurely: osmo-stp_10.42.42.5(pid=14839) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14839)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14851): Process ended prematurely: osmo-stp_10.42.42.5(pid=14851) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14851)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14869): Process ended prematurely: osmo-stp_10.42.42.5(pid=14869) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14869)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14879): Process ended prematurely: osmo-stp_10.42.42.5(pid=14879) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14879)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14889): Process ended prematurely: osmo-stp_10.42.42.5(pid=14889) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14889)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=14906): Process ended prematurely: osmo-stp_10.42.42.5(pid=14906) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14906)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14918): Process ended prematurely: osmo-stp_10.42.42.5(pid=14918) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14918)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14936): Process ended prematurely: osmo-stp_10.42.42.5(pid=14936) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14936)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14946): Process ended prematurely: osmo-stp_10.42.42.5(pid=14946) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14946)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14956): Process ended prematurely: osmo-stp_10.42.42.5(pid=14956) [trial-2364↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14956)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14972): Process ended prematurely: osmo-stp_10.42.42.5(pid=14972) [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14972)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14987): Process ended prematurely: osmo-stp_10.42.42.5(pid=14987) [trial-2364↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14987)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14995): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14995) [trial-2364↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14995)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15005): Process ended prematurely: osmo-stp_10.42.42.5(pid=15005) [trial-2364↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15005)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=15014): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15014) [trial-2364↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15014)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15025): Process ended prematurely: osmo-stp_10.42.42.5(pid=15025) [trial-2364↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15025)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15039): Process ended prematurely: osmo-stp_10.42.42.5(pid=15039) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15039)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15050): Process ended prematurely: osmo-stp_10.42.42.5(pid=15050) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15050)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15064): Process ended prematurely: osmo-stp_10.42.42.5(pid=15064) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15064)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15075): Process ended prematurely: osmo-stp_10.42.42.5(pid=15075) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15075)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15089): Process ended prematurely: osmo-stp_10.42.42.5(pid=15089) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15089)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15100): Process ended prematurely: osmo-stp_10.42.42.5(pid=15100) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15100)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15114): Process ended prematurely: osmo-stp_10.42.42.5(pid=15114) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15114)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15126): Process ended prematurely: osmo-stp_10.42.42.5(pid=15126) [trial-2364↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15126)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15141): Process ended prematurely: osmo-stp_10.42.42.5(pid=15141) [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15141)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15152): Process ended prematurely: osmo-stp_10.42.42.5(pid=15152) [trial-2364↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15152)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15166): Process ended prematurely: osmo-stp_10.42.42.5(pid=15166) [trial-2364↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15166)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15177): Process ended prematurely: osmo-stp_10.42.42.5(pid=15177) [trial-2364↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15177)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=15467): Process ended prematurely: osmo-stp_10.42.42.5(pid=15467) [trial-2364↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15467)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15479): Process ended prematurely: osmo-stp_10.42.42.5(pid=15479) [trial-2364↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15479)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=15497): Process ended prematurely: osmo-stp_10.42.42.5(pid=15497) [trial-2364↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15508): Process ended prematurely: osmo-stp_10.42.42.5(pid=15508) [trial-2364↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15508)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15518): Process ended prematurely: osmo-stp_10.42.42.5(pid=15518) [trial-2364↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15518)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=15536): Process ended prematurely: osmo-stp_10.42.42.5(pid=15536) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15536)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15548): Process ended prematurely: osmo-stp_10.42.42.5(pid=15548) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15548)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15566): Process ended prematurely: osmo-stp_10.42.42.5(pid=15566) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15566)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15576): Process ended prematurely: osmo-stp_10.42.42.5(pid=15576) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15576)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15589): Process ended prematurely: osmo-stp_10.42.42.5(pid=15589) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15589)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15606): Process ended prematurely: osmo-stp_10.42.42.5(pid=15606) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15606)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15619): Process ended prematurely: osmo-stp_10.42.42.5(pid=15619) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15619)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15637): Process ended prematurely: osmo-stp_10.42.42.5(pid=15637) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15637)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15647): Process ended prematurely: osmo-stp_10.42.42.5(pid=15647) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15647)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15657): Process ended prematurely: osmo-stp_10.42.42.5(pid=15657) [trial-2364↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15657)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15671): Process ended prematurely: osmo-stp_10.42.42.5(pid=15671) [trial-2364↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15671)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15684): Process ended prematurely: osmo-stp_10.42.42.5(pid=15684) [trial-2364↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15684)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=15693): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15693) [trial-2364↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15693)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=15703): Process ended prematurely: osmo-stp_10.42.42.5(pid=15703) [trial-2364↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15703)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15717): Process ended prematurely: osmo-stp_10.42.42.5(pid=15717) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15717)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15728): Process ended prematurely: osmo-stp_10.42.42.5(pid=15728) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15728)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15743): Process ended prematurely: osmo-stp_10.42.42.5(pid=15743) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15743)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15754): Process ended prematurely: osmo-stp_10.42.42.5(pid=15754) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15768): Process ended prematurely: osmo-stp_10.42.42.5(pid=15768) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15768)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15780): Process ended prematurely: osmo-stp_10.42.42.5(pid=15780) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15780)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15794): Process ended prematurely: osmo-stp_10.42.42.5(pid=15794) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15794)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15805): Process ended prematurely: osmo-stp_10.42.42.5(pid=15805) [trial-2364↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15805)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15820): Process ended prematurely: osmo-stp_10.42.42.5(pid=15820) [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15820)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15831): Process ended prematurely: osmo-stp_10.42.42.5(pid=15831) [trial-2364↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15831)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15846): Process ended prematurely: osmo-stp_10.42.42.5(pid=15846) [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15846)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15857): Process ended prematurely: osmo-stp_10.42.42.5(pid=15857) [trial-2364↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15857)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15871): Process ended prematurely: osmo-stp_10.42.42.5(pid=15871) [trial-2364↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15882): Process ended prematurely: osmo-stp_10.42.42.5(pid=15882) [trial-2364↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15882)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=15900): Process ended prematurely: osmo-stp_10.42.42.5(pid=15900) [trial-2364↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15900)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=15912): Process ended prematurely: osmo-stp_10.42.42.5(pid=15912) [trial-2364↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15912)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=15930): Process ended prematurely: osmo-stp_10.42.42.5(pid=15930) [trial-2364↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15930)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15950): Process ended prematurely: osmo-stp_10.42.42.5(pid=15950) [trial-2364↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15950)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16311): Process ended prematurely: osmo-stp_10.42.42.5(pid=16311) [trial-2364↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16311)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=16503): Process ended prematurely: osmo-stp_10.42.42.5(pid=16503) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16503)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16517): Process ended prematurely: osmo-stp_10.42.42.5(pid=16517) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16517)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=16535): Process ended prematurely: osmo-stp_10.42.42.5(pid=16535) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16535)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16545): Process ended prematurely: osmo-stp_10.42.42.5(pid=16545) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16545)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16555): Process ended prematurely: osmo-stp_10.42.42.5(pid=16555) [trial-2364↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16555)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16573): Process ended prematurely: osmo-stp_10.42.42.5(pid=16573) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16573)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16585): Process ended prematurely: osmo-stp_10.42.42.5(pid=16585) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16585)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16603): Process ended prematurely: osmo-stp_10.42.42.5(pid=16603) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16603)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16616): Process ended prematurely: osmo-stp_10.42.42.5(pid=16616) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16616)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16626): Process ended prematurely: osmo-stp_10.42.42.5(pid=16626) [trial-2364↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16626)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=16646): Process ended prematurely: osmo-stp_10.42.42.5(pid=16646) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16646)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16662): Process ended prematurely: osmo-stp_10.42.42.5(pid=16662) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16662)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=16680): Process ended prematurely: osmo-stp_10.42.42.5(pid=16680) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16680)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16690): Process ended prematurely: osmo-stp_10.42.42.5(pid=16690) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16690)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16700): Process ended prematurely: osmo-stp_10.42.42.5(pid=16700) [trial-2364↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16700)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16713): Process ended prematurely: osmo-stp_10.42.42.5(pid=16713) [trial-2364↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=16721): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16721) [trial-2364↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16721)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=16723): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16723) [trial-2364↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16723)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=16725): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16725) [trial-2364↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16725)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16727): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16727) [trial-2364↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16727)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=16736): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16736) [trial-2364↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16736)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=16747): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16747) [trial-2364↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16747)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16759): Process ended prematurely: osmo-stp_10.42.42.5(pid=16759) [trial-2364↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16759)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16770): Process ended prematurely: osmo-stp_10.42.42.5(pid=16770) [trial-2364↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16770)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16784): Process ended prematurely: osmo-stp_10.42.42.5(pid=16784) [trial-2364↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16784)] FAIL: register_a5_0_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16795): Process ended prematurely: osmo-stp_10.42.42.5(pid=16795) [trial-2364↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16795)] FAIL: register_a5_1_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16806): Process ended prematurely: osmo-stp_10.42.42.5(pid=16806) [trial-2364↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16806)] FAIL: register_a5_3_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16817): Process ended prematurely: osmo-stp_10.42.42.5(pid=16817) [trial-2364↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16817)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=16843): Process ended prematurely: srsepc(pid=16843) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16843)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=16859): Process ended prematurely: srsepc(pid=16859) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16859)] FAIL: iperf3_dl.py (19.0 sec) Error: srsepc(pid=16876): Process ended prematurely: srsepc(pid=16876) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16876)] FAIL: iperf3_ul.py (19.3 sec) Error: srsepc(pid=16892): Process ended prematurely: srsepc(pid=16892) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16892)] FAIL: ping.py (18.8 sec) Error: srsepc(pid=16908): Process ended prematurely: srsepc(pid=16908) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16908)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=16924): Process ended prematurely: srsepc(pid=16924) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16924)] FAIL: rrc_idle_mt_ping.py (18.1 sec) Error: srsepc(pid=16940): Process ended prematurely: srsepc(pid=16940) [trial-2364↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16940)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16955): Process ended prematurely: osmo-stp_10.42.42.5(pid=16955) [trial-2364↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16969): Process ended prematurely: osmo-stp_10.42.42.5(pid=16969) [trial-2364↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16969)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16985): Process ended prematurely: osmo-stp_10.42.42.5(pid=16985) [trial-2364↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16999): Process ended prematurely: osmo-stp_10.42.42.5(pid=16999) [trial-2364↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16999)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17026): Process ended prematurely: osmo-stp_10.42.42.5(pid=17026) [trial-2364↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17026)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17298): Process ended prematurely: osmo-stp_10.42.42.5(pid=17298) [trial-2364↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17298)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17313): Process ended prematurely: osmo-stp_10.42.42.5(pid=17313) [trial-2364↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17327): Process ended prematurely: osmo-stp_10.42.42.5(pid=17327) [trial-2364↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17327)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17341): Process ended prematurely: osmo-stp_10.42.42.5(pid=17341) [trial-2364↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17341)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17355): Process ended prematurely: osmo-stp_10.42.42.5(pid=17355) [trial-2364↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17355)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17369): Process ended prematurely: osmo-stp_10.42.42.5(pid=17369) [trial-2364↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17369)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17383): Process ended prematurely: osmo-stp_10.42.42.5(pid=17383) [trial-2364↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17383)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17397): Process ended prematurely: osmo-stp_10.42.42.5(pid=17397) [trial-2364↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17397)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17411): Process ended prematurely: osmo-stp_10.42.42.5(pid=17411) [trial-2364↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17411)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17506): Process ended prematurely: osmo-stp_10.42.42.5(pid=17506) [trial-2364↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17544): Process ended prematurely: osmo-stp_10.42.42.5(pid=17544) [trial-2364↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17544)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=17560): Process ended prematurely: osmo-stp_10.42.42.5(pid=17560) [trial-2364↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17560)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17574): Process ended prematurely: osmo-stp_10.42.42.5(pid=17574) [trial-2364↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17574)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17588): Process ended prematurely: osmo-stp_10.42.42.5(pid=17588) [trial-2364↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17588)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17602): Process ended prematurely: osmo-stp_10.42.42.5(pid=17602) [trial-2364↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17602)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17616): Process ended prematurely: osmo-stp_10.42.42.5(pid=17616) [trial-2364↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17616)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17630): Process ended prematurely: osmo-stp_10.42.42.5(pid=17630) [trial-2364↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17630)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17644): Process ended prematurely: osmo-stp_10.42.42.5(pid=17644) [trial-2364↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17644)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=17658): Process ended prematurely: osmo-stp_10.42.42.5(pid=17658) [trial-2364↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17658)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17672): Process ended prematurely: osmo-stp_10.42.42.5(pid=17672) [trial-2364↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2364↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=17702): Process ended prematurely: osmo-stp_10.42.42.5(pid=17702) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17702)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=17716): Process ended prematurely: osmo-stp_10.42.42.5(pid=17716) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17716)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=17730): Process ended prematurely: osmo-stp_10.42.42.5(pid=17730) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17730)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17744): Process ended prematurely: osmo-stp_10.42.42.5(pid=17744) [trial-2364↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17744)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=17772): Process ended prematurely: osmo-stp_10.42.42.5(pid=17772) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17772)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=17786): Process ended prematurely: osmo-stp_10.42.42.5(pid=17786) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17786)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=17801): Process ended prematurely: osmo-stp_10.42.42.5(pid=17801) [trial-2364↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17801)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=17815): Process ended prematurely: osmo-stp_10.42.42.5(pid=17815) [trial-2364↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17815)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17829): Process ended prematurely: osmo-stp_10.42.42.5(pid=17829) [trial-2364↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17829)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17843): Process ended prematurely: osmo-stp_10.42.42.5(pid=17843) [trial-2364↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17843)] + rm -rf trial-2364/inst + cd trial-2364 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 20:04:33 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364-run.tgz run.2022-12-09_20-04-44 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2364-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30039.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4699.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE